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Foreword 


“The Critical Issues in Psychology Series,” paperback source books 
for the undergraduate in psychology, are designed to provide authorita- 
tive and provocative reviews of selected topics germane to a spectrum of 
courses. Each volume offers an original inquiry into major facets of the 
point at issue and a set of illuminating reports carefully chosen to rep- 
resent salient positions of historical or current significance. This combina: 
tion will afford instructor and student opportunity to read stimulating, 
even challenging, argument with primary sources in hand. 

Interest in the topic of this volume, Curiosity and Exploratory Behavior, 
is only a recent development in psychology. Experimental psychologists, 
long concerned with motivational processes induced by deprivation of 
biological needs, have been slow to investigate these commonplace be- 
haviors. Once such investigations were initiated, however, they pro- 
liferated rapidly, and today this topic is afforded the attention so long 
denied it. 

Harry Fowler is Associate Professor of psychology at the University 
of Pittsburgh, and has taught there since receiving his Ph.D. in experi- 
mental psychology from Yale. He is the author of a number of experi- 
mental and theoretical reports on the problem of curiosity and exploratory 
behavior, having been for the past several years in the forefront of this 
new field of experimentation. His active interest in and investigation of 
the learning, motivational, and perceptual processes relevant to this kind 
of behavior make him well suited to evaluate the complexities inherent 
in the subject. 


Me vin H. Marx, General Editor 
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Preface 


James B. CONANT ONCE REFERRED TO THE DEVELOPMENTS 
within the areas of the physical sciences as “an interweaving of fruitful 
concepts.” This felicitous phrase now seems quite fitting for a behavioral 
science like psychology, for within its brief history, psychology has been 
characterized by continuous interchanges of concepts, concepts prompt- 
ing varied researches that, in turn, have generated additional problems 
and new conceptualizations. The central purpose of this book is to illu- 
minate this characteristic development of psychology, relatively free of 
the actual complexities of research and methodological minutiae. Specif- 
ically, its goal is to describe the role of certain of psychology’s more “fruit- 
ful” concepts, and through selective reference to the content area of 
curiosity and exploration, illustrate the manner in which these concepts 
have exerted a guiding influence on the development of this science. 

I have tried to satisfy this purpose through an explanatory interpreta- 
tion, bridged to articles selected to represent the significant empirical 
and theoretical developments within the scope of exploratory behavior. 
The essay itself is divided into four chapters covering fairly distinct seg- 
ments of the problem in rough historical progression. Because this book 
is intended primarily to supplement texts for undergraduate courses in 
experimental psychology, motivation, and learning (or their theoretical 
counterparts), an attempt has been made to keep the level of exposition 
relatively simple, particularly at the beginning of the discussion, where 
focus is on the nature and function of theory and the multiude of con- 
ceptual developments preliminary to the intensification of research on 
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curiosity and exploration in the early 1950’s. Comparable simplification 
has been attempted with the variety of concepts introduced, such as 
information-theoretic ones, and the incentive-motivational construct, 
together with its underlying anticipatory-response mechanism. Hope- 
fully I have not distorted their meaning or their intent. In this context, 
it seems appropriate to note that the application of the incentive-motiva- 
tional construct to exploratory phenomena (Chapter III) represents its 
formal introduction to the area; similarly, much of my personal research 
reported in relation to this concept, and its inclusion in a broader drive- 
incentive formulation, is here published for the first time. 

My indebtedness in writing and editing this volume is to many indi- 
viduals whose thoughts and comments have shaped my own. I am espe- 
cially grateful to Austin Jones for detailed and constructive criticisms 
of the entire manuscript. My thanks are also due Janet Tyler, Barbara 
Harris and Sandra Senior for painstaking clerical assistance. Most of all, 
for patience and understanding during this preoccupation, I thank my 
wife Dolores. 

Grateful acknowledgement is also made to the following individuals 
and organizations for their kind permission to reproduce the articles 
selected for reading: G. W. Barnes, A. Baron, D. E. Berlyne, R. A. But- 
ler, J. F. Dashiell, W. N. Dember, W. Dennis, D. G. Forgays, M. Glan- 
zer, H. F, Harlow, D. O. Hebb, C. Leuba, H. Levin, N. E. Miller, A. K. 
Myers, and P. G. Zimbardo; the American Psychological Association, 
Southern Universities Press, and the Williams and Wilkins Company, 
Inc. Finally, I should like to acknowledge that the previously unpub- 
lished research reported herein was supported in part by a grant (MH 
04549, currently, HD 00910) from the National Institutes of Health, 
United States Public Health Service. 


Harry FOWLER 
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PART ONE 


Inquiry and Argument 


CHAPTER 


The Problem and Its History 


WITH THE ADVENT OF PSYCHOLOGY AND THE TWENTIETH 
century, a diversified group of behaviors was brought under inten- 
sive experimental analysis, but for a good many years, those activities 
that came under the labels of curiosity and exploration received 
little consideration. In fact, prior to 1950, systematic investigations of 
these behaviors were unavailable, and the few, isolated bits of 
research that had appeared on the subject served only to reflect 
its perfunctory treatment. This early indifference toward curiosity 
and exploration was due primarily to the psychologist’s concern 
with the biological significance of behavioral events; under the 
prevailing Darwinian influence, behaviors such as food and water 
seeking required urgent study because of their crucial function in 
providing for the organism’s well-being and, hence, its survival. 
In this regard, curiosity and exploratory behaviors seemed of little 
consequence. 

Once the phenomenon of exploration began to receive serious at- 
tention in the early 1950's, the impetus for its continued analysis 
was of sufficient intensity to promote a wealth of findings within the 
short span of the subsequent decade. Two factors were of promi- 
nence in fostering this recent concern with exploration. First, many 
investigators came to recognize that a good portion of the organism’s 
behavior, especially man’s, was characterized not so much by those 
activities that served to maintain its biological well-being, but rather 
by those pronounced and prominent tendencies that it had to 
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explore, to investigate, or, in general, to seek out new forms of stim- 
ulation, In this respect, then, investigations of curiosity and explora- 
tory behaviors were just as important as the intensive study that had 
earlier been given to the “more basic” activities of seeking food and 
water or escaping from pain. 

A second, if not related, factor that prompted research in the area 
of exploration was the concern expressed by other investigators that 
any general theory of behavior that neglected curiosity and explora- 
tion would be seriously deficient. Indeed, with preliminary analysis 
of these behaviors in the early fifties, serious doubt was cast upon 
the adequacy of the concepts and principles that formed the bulwark 
of contemporary theory. And, as investigation proceeded, the find- 
ings uncovered were of sufficient consequence to call for both the 
modification of existing theory and the development of new con- 
ceptualizations. These developments have currently led the be- 
havioral investigator to a threshold of new problems and still 
additional challenges; but, with all of this, there has occurred a. 
further and progressively more rapid development of his science. 


The purpose of this essay is to present and critically discuss the 
developments that have mark 
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what factors make the organism act? Aside from the initiation of 
activity, what conditions underlie the different levels of performance 
or the different strengths of response that are observed for different 
animals or for the same animal at different points in time? And still 
further, what factors relate to the animal’s engaging with a particu- 
lar degree of vigor in one type of activity rather than some other? 
_ These questions have often been used to describe the problem 
area of motivation. In the present context, the term behavior varia- 
bility is employed rather than motivation because the area for the 
latter is by no means clearly delineated. Questions similar to the 
above also confront the psychologist interested in the process of 
learning; indeed, the task of distinguishing the learning process from 
that of performance or motivation seems to be an ever-present one. 
It is similarly noteworthy that the above questions have often been 
posed in the form “Why?” rather than “What are the conditions and 
factors?” This is somewhat unfortunate because, strictly speaking, 
the scientist is not interested in the reasons for a particular event, 
behavioral or otherwise, but rather the mechanics underlying the 
event. This issue may be posed in its broadest framework by noting 
that the scientist is not concerned with why the universe, including 
its behavioral component, is as it is; instead, his concern is with 
the orderliness and “workings” of the universe or various aspects 
of it. 

The fact that the behavioral scientist is interested in the “me- 
chanics” of behavior should imply that his task is not complete once 
the conditions and factors relating to a particular behavior have 
been discovered and isolated; or, for that matter, how or in what 
ways these conditions affect the behavior. Specification of these 
determining conditions and the relationships existing between them 
and the behavior under study can only provide a collection of un- 
related empirical laws. Thus, were the task for the behavioral 
scientist complete at this point, the empirical laws on food-seeking 
activities would be unrelated to those on curiosity and exploratory 
behaviors, or those on fear and pain-terminating activities, or those 
on any other behavioral category designated. Moreover, the facts 
ascribed to a particular behavior, such as food seeking, would be 
related only insofar as they came under this behavioral heading, 
and this, in itself, can be an arbitrary matter. For these reasons, 
the behavioral scientist must attempt some sort of integration or 
systematic interpretation, both within and across “behavioral cate- 
gories,” of the empirical laws that have been ascertained. 
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The Use of Conceptual Schemes 


To effect a systematic interpretation of behavior, the psychologist 
must specify and describe those processes that underlie behavioral 
variability in all of its aspects, from the i 


nitiation, maintenance, and 
termination of one behavior to 


the selection of another, Unfortu- 
ng behavioral variability are not 
hysiological level of inquiry. Refer- 
sses in terms of physiological events, 
oblem of specifying them or their 
ce has already been alluded to and 


an animal; in ad- 
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is not realized, however, with the specification of a single defining 
relationship such as that noted with the condition of food depriva- 
tion. To serve in an integrative capacity, the concept must “tie in” 
or bring together a number of empirical relationships. Thus, the 
concept is also defined, as in current theorizing, in terms of a host 
of other conditions or variables, such as extremes of temperature, 
amount or length of water deprivation, intensity of electric shock, 
loudness of sound, and so on, and correspondingly, its “energizing” 
function is expressed in terms of the effects that these variables have 
on behavior. In this fashion, different sets of empirical laws relating 
to a number of conditions and variations in behavior are unified 
under a common conceptual scheme, and a systematic interpretation 
of behavior is effected. 


Specific Requirements for a Concept 

The extent to which a concept or conceptual scheme may serve 
in an integrative capactiy will certainly be an important considera- 
tion in determining its usefulness. Nevertheless, there are two 
additional considerations that relate to the adequacy of the concept 
itself. The first of these considerations is whether the concept is 
meaningful—that is, whether the properties or functions ascribed 
to the concept are adequately reflected in the behavioral events that 
are produced by the conditions that define the concept. By ascribing 
an “energizing” or “activating” function to a motivational concept 
and defining it in terms of amount or length of food deprivation, 
for example, we must be able to demonstrate that when this motiva- 
tional process is made operative, by depriving the animal of food, 
the level of performance or the strength of the particular behavior 
performed by the animal is, in fact, elevated or increased—for ex- 
ample, frequency of bar pressing for food is heightened, speeds of 
running are faster, amounts eaten are greater, and so on. In addition, 
it will be necessary to show that the strengths of these behaviors are 
greater with longer periods of food deprivation because, according 
to our definition, the animal's motivation has been increased. These 
demonstrations, which provide the concept with an “operational” 
definition, will also be required with the other conditions—water 
deprivation, electric shock, and so on—used to define the concept, 
especially if it is to serve in an integrative capacity. 

The second consideration regarding the adequacy or worth of a 
Concept is whether it is fruitful—that is, whether on the basis of the 
concept and the propositions specifying its functions and defining 
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conditions, we can predict new events and thereby generate addi- 
tional research. Although these predictions are typically derived on 
the basis of a theoretical system comprised of a number of concepts 
and propositions describing their functions, in the context of the 
motivational concept referred to and the conditions that have been 
specified as defining this concept, we may infer that any condition 
of deprivation or intense stimulation may motivate the organism— 
that is to say, energize its responses, And on the basis of this propo- 
sition, we may hypothesize that the strength of the animal’s responses 
will be greater when, for example, conditions of oxygen deprivation 
or intense light are imposed upon it. More directly, perhaps, we 
might predict that by subjecting the animal to combinations of the 
conditions defining the motivational process—both food deprivation 
and loud noise, for example—their energizing effects will summate, 
causing the strength of the animal’s responses to be greater than 
when either of these conditions is operative alone. The utility of 
these predictions and those derived from other concepts, or concepts 
in combination, rests with the fact that the findings of the research 
that these predictions may generate, should serve, if in agreement, 
to promote the generality of the conceptual scheme or theory em- 
ployed, and, if in opposition, to spur us on to appropriate modifica- 


tions of the theory or to new and hopefully better conceptualizations 
of behavior variability. 


The quest for concepts th 
ful to enable an integr: 
the unending task to which the investig: 
herein lies understanding in 


EARLY CONCEPTUALIZATIONS 


From antiquity until not more th 
an a centur 
behavior va y ago, the problem of 


riability was treated quite differently for man and lower- 
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order creatures. Man was viewed as a rational being whose behavior 
involved reflection and judgement; the acts of animals, on the other 
hand, were cast as being blind, mechanical in nature, and without 
such reason or reflection. With this man-brute dichotomy of be- 
havior, it was averred that a rational soul governed Man’s acts, 
whereas only natural or divinely implanted instincts directed the 
behavior of other creatures. This conceptualization, which seems to 
have originated with Stoic philosophers of the first century A.D. (see 
Wiln, 1925), was rather flattering to man, because it placed him in 
a community shared only by other rational beings, namely his gods. 
Moreover, with the propagation of a similar doctrine by Christian 
theologians, man was afforded the unique position of being able 
to differentiate “good” from “evil,” to act accordingly, and thereby 
to earn his own salvation. Unfortunately, with both of these philoso- 
phies, sacred and secular, the premises concerning the behavioral 
differences between man and the lower-order animals were without 
empirical foundation; they had not been inferred from objective 
evidence or observation, but merely dictated by the assumption of 
these philosophies that animals lacked a rational soul (see Beach, 
1955). 

With the appearance of Origin of Species in 1859, the man-brute 
dichotomy began to lose credence; Darwin’s espousal of a biological 
continuity between these species suggested a similar continuity in 
their behavior, a notion that was made explicit by him in his later 
writings (Darwin, 1872). Proponents of evolutionary theory were 
then led to accept (rather uncritically) the proposition that all be- 
havior was governed either by instincts or by a rational soul. Hence, 
they sought to demonstrate both that animals could reason and 
humans had instincts. Apparently, this influence prevailed on some 
of the early psychologists of the time, for in his monumental text 
The Principles of Psychology, James (1890) averred that man had 
more instincts than other animals, so many, in fact, that they tended 
to obscure one another. In the course of this intellectual ferment, 
the instinct concept gradually came to replace the animistic notion 


of a soul. 


The Instinct Concept 
The writings of McDougall (for example, 1912, 1923) provided 
the instinct concept with a formal introduction to psychological 
thinking. For McDougall, instincts were innate predisposers of 
purposive behavior—that is, native propensities that initiated man’s 
behavior and directed him to particular ends or goals. Accordingly, 
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instincts were given the specific function of predisposing the indi- 
vidual (a) to perceive and attend to particular stimuli or stimulus 
objects, (b) to become emotionally aroused in their presence, and 
(c) to make specific acts directed toward these objects. Because 
these instinctive acts were capable of being elicited by ideas or 
thoughts of the objects, in addition to the objects themselves, and 
also capable of being compounded, integrated, and even modified 
by learning (a notion that received earlier expression by James, 
1890), McDougall felt that he could account for the varieties and 
complexities of human behavior on the basis of a dozen or so in- 
stincts. Thus, the instinct concept was to serve in both a descriptive 
and an explanatory capacity, designating certain if not all of the 
components of the behavior observed as being innate or unlearned 
and also accounting for the behavior’s occurrence. 

Under the prevailing D 
doctrine gained considera 
the gap between animal 
success of the instinct doct 
and sociologists alike be 
The sociologist Bernard 


time to time, Moreover, some of the instinctive acts 


love and self-assertion, for which specific instincts had been posited, 
rom culture to culture, su: i 
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hardly serve as a scientific explanation of behavior. As a result, in- 
vestigators soon turned their attention to an analysis of the environ- 
mental conditions and biological processes that presumably affected 
the so-called instinctive acts, and out of these endeavors, a new 
conceptualization was formed. 


The Drive Concept 

The development of the new concept of drive was actually coin- 
cidental with that of instinct. As early as 1918, while McDougall 
was propounding his instinct doctrine, Woodworth used the term 
drive to designate an energy dimension of behavior. And while 
battle cries over the instinct notion were being sounded in the 
twenties, other psychologists, notably Moss (1924), Richter (1922, 
1927), Carr (1925), and Dashiell (1928), were advancing the basic 
thesis that behavior was dependent upon the animal's drive state. 

For both Moss (1924) and Richter (1922, 1927), drives were 
internal, biological disturbances that drove or forced the animal into 
activities that restored the natural balance or equilibrium of its 
internal state, a condition to which Cannon (1932) subsequently 
gave the label homeostasis. Thus when an organism was lacking of 
food, for example, the resulting internal disturbances aroused or 
stimulated the animal into “random,” restless activity that persisted 
until food was obtained and the drive sufficiently reduced. When 
this imbalance recurred, the process was repeated; with time and 
similar experiences, however, the random activity was gradually 
excluded, because those movements or responses leading to food 
became more strongly associated with the stimulation (for example, 
the stomach contractions) characteristic of the imbalance brought 
about by the lack of food. Thus with this drive conceptualization of 
behavior, a basis was laid both for the initiation or arousal of gen- 
eral activity and the subsequent selection of specific behaviors that 
restored the natural balance of the animal's internal state. 

A similar thesis was expounded by Carr (1925), who posited 
hunger, thirst, sex, pain, and extremes of temperature as some of the 
fundamental or primary motives that dominated the organism’s 
behavior, These motives, or drives as they were also called, were 
characterized by relatively intense, persistent stimuli that affected 
the organism until it responded in such a way that its “organic 
needs” for food, water, and so on, were satisfied. Hence, motives 
or drives served, through the responses that they directed, to sustain 
the biological well-being of the organism and, in the case of the 


12 Inquiry and Argument 


sex motive, the species itself. Because Carr (1925) felt that the 
individual animal would not be motionless in the absence of these 
drives, he gave particular emphasis to their directive function, in 
contrast to Moss (1924) and Richter (1922, 1927), who stressed 
their energizing or activating property. Carr’s view was also ex- 
pounded by Dashiell (1928), who argued that spontaneous activity 
could occur simply as a result of the metabolic functioning of the 
organism. Nevertheless, Dashiell (1928) ascribed both energizing 
and directive functions to the primary drives, because, along with 
their characteristic stimulation, they served both to get man into 
action and to influence the course of his behavior. 

The varied and complex actions of both men and animals seemed 
not to be explained, however, simply on the basis of the energizing 
and directive services provided by the primary drives, especially 
because much of their activity, a good case of which was exploration, 
apparently occurred in the absence of these drives. For this reason, 
Dashiell (1928) suggested, as Tolman (1925b) had earlier, that 


the drive conceptualization could be extended to include secondary 


or learned drives, Through the action of stimulus substitution (clas- 


sical conditioning), those neutral stimuli in the animal’s environ- 
ment that were consistently 


could come to elicit, indepe 
forces that typically resulte: 
intense external stimulation, 


mal was consistently brought 
these novel stimuli served in and: of 
type of drive behavior.” 
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clearly reflected in their writings: Mowrer, 1939; Miller and Dollard, 
1941; Hull, 1943, 1952; Spence, 1944, 1956; Dollard and Miller, 
1950; Brown, 1953b, 1961. 

Individual formulations of behavior variability differed signifi- 
cantly among the contemporay drive theorists, and even for the 
same theorist, from time to time. Collectively, however, their position 
remained quite similar to that espoused by early proponents of the 
drive concept. Operational definitions of the primary or innate drives 
included conditions of deprivation relating, for example, to food, 
water, and sex, and also intense external stimulation, such as electric 
shock, extreme heat or cold, intense light, and loud noise. In turn, 
these defining conditions were assumed to produce a drive state that 
(a) energized those responses that were innately associated with or 
previously conditioned to the stimuli impinging upon the animal 
at a given moment, and (b) provided a basis for the learning (rein- 
forcement or strengthening ) of new associations between the imping- 
ing stimuli and the responses that led to a reduction of the drive 
state, In addition, it was assumed that the drive-defining conditions 
produced characteristically different internal stimuli to which re- 
sponses could be conditioned through the process of reinforcement. 


Additional Refinements 

Although the general formulation adopted by the contemporary 
drive theorists remained quite similar to that espoused by the early 
theorists, certain refinements, qualifying statements, and points of 
emphasis did emerge, along with an air of caution regarding the 
application of the model to all of behavior. First, it was stated rather 
explicitly that a drive state was not an observable, physical entity 
but only a theoretical construct that, through its ascribed functions, 
could serve to integrate the empirical relationships that had been or 
were to be obtained between the antecedent conditions in which 
the drive was defined and the behavioral consequents in which its 
functions were given expression. Thus, for Hull (1943, 1952) drive 
was a central state that was not directly observable; similarly, for 
Spence (1944, 1956), it was a construct that had no substantive 
reality but that, as a theoretical variable intervening between cer- 
tain antecedent conditions and behavioral consequents, was con- 
venient for purposes of integrating the facts within the relatively 
circumscribed area of investigation designated by these conditions 
and behaviors. For this reason, in part, the former notion that drives 
or motives related to the “organic needs” of the animal was 
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eventually discarded (Dollard and Miller, 1950; Hull, 1952), even 
though it had been expressed in the earlier writings of some of the 
contemporary theorists (for example, Hull, 1943). It became evi- 
dent, moreover, that the animal’s “needs” did not bear 
relationship with its drives and their ener 
erty. The animal might need, for example, to escape or avoid carbon 
monoxide in order to remain healthy, and even to survive, but the 
mere presence of this stimulus condition, undetectable as it is, did 
not energize behavior. 

A second refinement pertained to the specification and interpreta- 
tion of both the drive’s functions and its defining or antecedent con- 
ditions. Because even those conditions of deprivation that were 
used to define the drive concept seemed to entail intense, persistent 
stimuli, such as the “parching” sensation associated with the lack of 
water or the “gnawing” of the stomach with the absence of food, 
Miller and Dollard (1941) posited the general, defining principle 
that “strong stimuli which impel action are drives.” It was cautioned, 
nevertheless, that this general definition did not imply that all drives 


were strong stimuli. Other conditions of stimulati 
which the animal's 


any one-to-one 
gizing or activating prop- 


if, for example, the 
§ or pain-eliciting situ- 
then these situations or 
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reflected in measures of them as, for example, in their frequency or 
length of occurrence. 


The Concepts of Drive Reduction and Habit 

A third development, and perhaps the most important was the 
emphasis placed on drive reduction as the theoretical mechanism 
of reinforcement—that is, the means by which a response became 
more strongly associated with a particular stimulus or set of stimuli 
and, thus, more prepotent when the animal was again confronted 
with these stimuli or a similar set. This concept of reinforcement 
was implicit in the writings of some of the early drive theorists (for 
example, Richter, 1922), but its formalization did not occur until 
later (for example, Dollard and Miller, 1950; Hull, 1952; Miller and 
Dollard, 1941). Moreover, with its formalization, it was made ex- 
plicit that the reduction of a painfully strong or intense stimulus 
need not be the only form of reinforcement (for example, Dollard 
and Miller, 1950). Because strong stimuli served as drives, but not 
all drives were necessarily strong stimuli, reinforcement might also 
be occasioned through the reduction or termination of other drive- 
defining conditions. Thus, the drive-reduction or, more accurately, 
intense-stimulus-reduction theory of reinforcement was put forth as 
a working hypothesis—one that would serve both to explain some 
of the currently existing data and also to stimulate additional re- 
search or, as Miller has often commented personally, “to infuriate 
someone into performing really good experiments disproving it.” 

A fourth refinement within contemporary drive theory concerned 
the role played by drives in directing behavior. Although the early 
theorists had ascribed both energizing and directive properties to 
drives, contemporary theorists tended to argue for their separation 
(for example, Hull, 1943, 1952; and especially Brown, 1953b). 
General and specific behaviors could be energized by drives, but 
the directing or guiding of these behaviors was effected only 
through habits—that is, the innate, previously learned, or to-be- 
uld exist between the animal’s responses 
and the stimuli confronting the animal at a particular moment. Thus, 
a distinction was drawn between the energizing function of a drive 
state and the directing property of drive stimuli, both of which were 
defined in terms of the antecedent conditions of deprivation and 
intense stimulation. A similar thesis was advanced by Dollard and 
Miller (1950) with the distinction they drew between the “cue” 
properties of stimuli, to which responses could be conditioned and 


acquired associations that co 
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the intensity of these stimuli, which, if strong enough, impelled 
action. 

Contemporay drive theorists also extended their formulation, as 
had the earlier theorists, to include secondary or learned drives. In 
addition, the concept of secondary or learned rewards was intro- 
duced and formalized (for example, Miller and Dollard, 1941). 
Through classical conditioning, new habits or sti 


associations could be acquired, whereby, 


in the absence of the 
defining conditions that produced the drive and those that served 
to reduce it, previous] 


y neutral stimuli or stimulus conditions could 
independently occasion either the drive reaction itself or that of 
drive reduction. Thus, if an animal were repeatedly confronted in 
some neutral stimulus situation, A, for example, with an aversive 
stimulus that it consistently terminated by escaping to some non- 
aversive stimulus situation, B, two conditioning effects would be 
achieved: not only would stimulus A serve in the absence of the 
aversive stimulus to elicit a drive state (“fear”) which, in turn, 


energized the animal's existing habits and laid the basis for the 


mulus-response 


B was contingent. 
Theoretically, there was no limit t 
learned drives and reinforcers that co 


drive, for example, 
1951), those relati 


failed (for example, Myers and Miller [ 
i i y of some investigators to 


—that is, fail to distinguish 
d their associated stimuli— 


drives and habits 


The Problem and Its History 17 


CURRENT CONTROVERSY 

Apparently, the adequacy of the drive concept, like that of its 
predecessor, instinct, was not to evade strenuous dispute. Even with 
the refinements, qualifying statements, and elaborations posed by 
the contemporary drive theorists (and, in part, because of them), 
other investigators were able to uncover grounds for criticizing the 
formulation. Hebb [13], for example, in studying the emotional 
reactions of chimpanzees, observed certain “spontaneous fears” that 
seemed not to result from the primary drives or their derivatives. 
Posing this problem for drive theory, he asked: 


What is the drive that produces panic in the chimpanzee at the sight 
of a model of the human head; or fear in some animals, and vicious 
aggression in others, at the sight of the anesthetized body of a fellow 
chimpanzee? What about fear of snakes, or the young chimpanzee’s terror 
at the sight of strangers? One can accept the idea that this is “anxiety,” 
but the anxiety, if so, is not based on a prior association of the stimulus 


object with pain.? 


Similar protests were also voiced in reference to the arousal of 
behaviors for which the presumed motive was not a secondary one 
but, in fact, primary or innate. For example, Nissen (1953) noted 
that, although sexually naive or virginal chimpanzees tended not to 
copulate during mating sessions, they engaged in sundry activities, 
such as scratching, cleaning, caressing, or generally grooming one an- 
other, These activities seemed completely independent of the opera- 
tion of a sex motive, especially because they occurred in the absence 
of any copulatory activity. Moreover, the fact that these grooming 
behaviors occurred before the animals were sexually mature and 
even when a male was paired with another male or a female with 
another female argued strongly against their being elicited by any 
secondary or learned drive based on the primary one of sex. 

In essence, the argument posed by both Nissen (1953) and Hebb 
[13] was that many complex acts and even simple ones are independ- 
ent of the primary drives and their learned counterparts: 


Observation of animals and people in “free,” and even in highly “struc- 
tured,” situations indicates that much time and energy is taken up by 
brief, self-contained, often repetitive acts which are their own reason, 
which are autonomously motivated, and which are not to be interpreted 
as being small contributions to some remote, critically important aim. 
The organism scratches itself, stretches, shakes its head, grunts or chirps, 


2D, O. Hebb, “Drives and the C.N.S. (Conceptual Nervous System),” 
Psychological Review, 1955, 62, 245. 
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looks around, examines an irrelevant item 
nose or its teeth, rocks back and forth, 
clip out of shape, cracks its knuckles, d 
wall, and so on ad infinitum.3 


of the environment, picks its 
shifts its position, twists a paper 
oodles, looks at a picture on the 


To some of these “embarrassing” observations, the drive theorist 


could reply by noting, for example, that even such activities as 
scratching, or stretching, 


one’s position seem instig 
the animal tries to reduce, or that some of the behaviors might relate 
simply to spontaneous aci 

tioning of the animal, or 


chimpanzees could be due to the animals having previously experi- 


xpected events in the face of 
that the general grooming of 
ould not be expected to derive 


referred to as “self-contained 
flected to a large extent that 
ooking around, examining an 
» twisting a paper clip out of 
o forth, which came into focus 


The Problem of Exploratory Behavior 
Early studies by Harlow and his co 
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that the monkeys actually learned to solve the mechanical puzzles, 
indicated that the process underlying the reinforcement or strength- 
ening of the monkeys’ responses entailed not the decrement or re- 
duction in intense stimulation called for by contemporary drive 
theory but rather a maintenance or even an increase in stimulation. 
As a result, drive theorists were confronted with one of their more 
formidable challenges; the adequacy of both the drive concept and 
the hypothesis of reinforcement based on drive reduction was seri- 
ously questioned. 

These challenges to contemporay theory were to be expected; 
the drive theorists had not offered their formulation as an all-inclu- 
sive, final account of behavior. Such a policy would have been 
rather foolhardy in view of some of the radical, theoretical changes 
that had occurred in the older, more developed sciences. Even in 
physics, that enduring concept of “force” succumbed under the 
weight of time and relativity theory. But herein lay the task: in the 
face of these challenging observations, to modify existing theory or 
to develop new, more adequate conceptualizations by which the 
“embarrassing” behavior patterns could be explained. On this point, 
both the drive theorists and their critics seemed in agreement, for 
even staunch antagonists had to conclude: 


. the current criticisms of the drive doctrine do not so much show that 
it is “wrong,” as they point to the desirability of devising alternative, 
competing frameworks for the study of motivation. It may be that an 
alternative approach can deal with behavioral data at least as well as 
the drive doctrine and may perhaps be as fruitful in stimulating research.4 


4D. Bindra, Motivation: A Systematic Reinterpretation (New York: The 
Ronald Press Company, 1959), 16. 
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ingly enough, then, the theoretical development that initially took 
place in the context of exploration was not the development of a 
new concept but rather the extension of an old one. Nevertheless, 
the platform on which this extension was being propounded ap- 
peared somewhat unstable. The suggested extension of the drive 
concept stemmed, in part, from the apparent difficulties that the 
contemporary drive theorists had in accounting for exploration on 
the basis of the “homeostatic” or “interoceptive” drives relating to 
internal states of distress or imbalance. But these notions, which 
were advanced by the early drive proponents, had actually been 
discarded by the contemporary theorists. Moreover, in view of the 
emphasis that was placed by the contemporay theorists on intense, 
external stimuli as drive-defining conditions, the distinction drawn 
between interoceptively and exteroceptively aroused drive states 
seemed patently superficial. To make matters worse, the proposed l 
conceptualization had its own problems. yi: 
Because the concept of an exploratory drive was to serve in botho ; 
a summarizing and integrative capacity, it was imperative that it i 
be both meaningful and fruitful, in the sense described previously: () : 
(Chapter I). Unfortunately, the concept seemed loosely if not i> £ 
defined; reference was sometimes made to an exploratory drive ių | 
terms of observed variations in “exploration,” and, then, these bed x 
havioral differences were explained by the drive. As a result, thig : 
new concept soon bore the brunt of a strenuous attack by botlt 
drive theorists and critics alike. Brown, the drive theorist who had 
earlier argued against free usage of acquired-drive terminology 
(Brown, 1953b), commented similarly with reference to usage of 


an exploratory drive: 


to explore is sometimes inferred from, and 
lain, behavior of moving from one place to 
reason for the movement. 
ay is quite circular, and 


. the presence of a drive 
at the same time used to exp 
another, especially if there is no other apparent 
The postulation of an exploratory drive in this way is 1i 
therefore of questionable worth as a scientific explanation.? 


Critics of drive theory went further, questioning the adequacy of 


the concept even as a descriptive or summarizing device: 


In a few well-studied experimental situations, involving for the most 


part food deprivation, water deprivation, or electric shock as antecedent 
conditions, all of the ingredients of the operational definition are present 


2J. S. Brown, The Motivation of Behavior ( New York: McGraw-Hill Book 
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and “drive” can at least be used without ambiguity as a descriptive, or 
summarizing, concept. Its usefulness in this role breaks down, of course, 
when enthusiastic proponents extend usage of the term to situations in 
which only one of the defining relationships can be identifed, thereby 
generating such ill-endowed mutants as “exploratory drive.”. . . 


The essence of the arguments posed by both Brown (1961) and 
Estes (1958) is summarized rather well in a statement made by 
still another drive critic: “Where little is known about the conditions 
that control some behavior (e.g., exploratory behavior), the in- 
ference of a causal drive does little more than restate the facts to 
be explained.” + Indeed, very little was known about curiosity and 
exploration when the concept of an exploratory drive first tumbled 
into the psychological literature in the early 1950's. During the 
ensuing years, however, research in the area 
as a result, a wealth of findings was amasse 
that we review this recently formed empiric 
ing additional consideration to the problem 
the conceptualization noted above but also 
lations that accompanied it, 


began in earnest, and 
d. It would seem best 
al structure before giv- 
s that plagued not only 
other theoretical formu- 


AN EMPIRICAL Account: DEFIN 
AND DETERMINANTS 


To describe the empirical (or theoretical) nature of some class of 
behaviors, the investigator typically proceeds by defining the be- 
havior so that it may be studied and analyzed with respect to the 
conditions or factors that affect it. In the case of food- or water- 
seeking activities, for example, this task is relatively simple, because 
we may be guided in our definitions of these behaviors by certain, 


specific “goal” objects, and the responses that the animal makes to 
and for these objects. Thus, the study of fo 
behaviors entails observin 


ITIONS 
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object itself—consummatory responses, such as chewing, salivating, 
ingesting, or, in general, eating. 

Other classes of behaviors for which there are no discernible 
goal objects, as in the case of escape or pain-terminating activities, 
can be defined, nevertheless, in terms of certain goal conditions— 
for example, those that have relatively little, if any, aversive-stimu- 
lus characteristics. Comparably, then, the study of escape behavior 
may entail observing and measuring those responses that are instru- 
mental to the nonaversive condition and those “consummatory” 
responses—for example, “relief” or “relaxation’—occasioned by this 
goal condition. It seems evident that specification of different goal 
objects (or conditions) provides the basis by which we may distin- 
guish and study specific classes of behavior—except when we are 
confronted with the study of exploration. 


A Behavior Without a Definition 

The task of defining curiosity and exploration seems difficult if 
not impossible, for there appears to be no goal object or condition 
to and for which the organism responds. We might consider that 
the organism explores in order to acquire new forms of stimulation 
and, thus, as a first attempt at definition, view curiosity and explora- 
tion as behaviors that have the sole function of altering the stimuli 
that impinge upon the organism. However, immediate reflection 
suggests that this definition is most unsatisfactory. The effect of 
changing the organism’s stimulus field appears characteristic of all 
behaviors, food-seeking, pain-escaping, or otherwise. Moreover, 
each and every response may produce a perceptible change in the 
organism’s stimulation through the kinesthetic or proprioceptive 
stimulus components of the response. Thus, with this initial defini- 
tion of curiosity and exploration as behaviors that have the function 
of altering the impinging stimuli, we are faced with the fact that 
virtually all responses possess an exploratory function to some 
degree; and so it may be. 

Actually, the problem of 
haviors has only been treate 


defining curiosity and exploratory be- 
d quite recently. Berlyne (1963) sug- 
gests that the essential point of difference between “exploratory 
and other responses is that nonexploratory behaviors are accom- 


panied by biologically important effects on tissues other than the 
sense organs and the nervous system,” a fact that presumably does 


not hold for exploration. Curiosity and exploration may refer, then, 
to a wide assortment of behavioral events that have “nothing very 
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tangible to hold them together apart from our failure to recognize 
a specific biological function that can be associated with them.” 5 
Needless to say, “our failure” to recognize a specific biological func- 
tion for exploratory behaviors does not guarantee or insure an 
abserice of this function; nor does it provide us with much of a 
basis by which we may designate the goal of exploration and 
thereby study the responses to and for this goal. 

Perhaps our best attempt at defining exploration can be made 
on the basis of the classification of exploratory behaviors suggested 
by Berlyne (1963), namely intrinsic versus extrinsic types of explora- 
tion. Food seeking and other classes of behavior for which there are 
clearly discernible and unique consequents—that is, goal objects 
or conditions—may be viewed as extrinsic types of exploration. The 
exploration involved in these behaviors relates to the animal's 
receipt and consumption of specific goal objects (or conditions), the 
presence of which is fostered by conditions of de 


intense stimulation. On the other hand, intrin: 
would refer, 


privation and 
sic types of exploration 
by exclusion, to those behaviors that seem unrelated 
to any goal object, or condition of reinforcement—behaviors that 
appear to be for their own purpose. These intrinsic types of explora- 
tion have reference, then, to the class of acts that Nissen (1954) 
labeled as “self-contained” and “autonomously motivated.” 

As unsatisfactory as this “definition” of exploration may be, it 
appears nevertheless to be the one that guided early workers in 
the area. Studying curiosity and exploration simply meant observing 
the activities of animals that were not or had not been subjected to 
conditions of deprivation or intense stimulation, or confronted with 
the goal objects that “satisfied” these conditions. Perhaps cognizant 
of the difficulties involved in defining the behavior that they were 
attempting to study, the early investigators limited their observa- 
tions, almost exclusively, to the “intrinsic” exploratory activities of 
subhuman animals, primarily rodents and primates. With these 
animals, there seemed less chance that their exploratory perform- 
ances would be influenced by specific, perhaps implicit, goals such 
as might be the case for humans involved in complex activities 
relating to recreation, entertainment, or play. In any case, a host of 
studies was conducted showing that, without any apparent motive, 
or condition of motivation or reinforcement as imposed by the ex- 
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perimenter, animals would respond quite readily to stimulus objects 
and patterns of one form or another. And through the variety of 
measures and test procedures that were employed in these studies, 
consideration was given to the salient features, aspects, or proper- 
ties of the stimuli that evoked the so-called “exploratory tendencies.” 


Response to Novelty, Change, and Complexity 

Studies that employed choice procedures clearly demonstrated 
that animals would respond to novel stimuli or, more broadly, to a 
change in the complex of stimuli impinging upon them. For exam- 
ple, Kivy, Earl, and Walker (1956) permitted rats to investigate 
the choice-point region of a T maze, but prevented them from enter- 
ing the goal arms by means of glass partitions. During this exposure 
period, both arms were of the same brightness—for example, black. 
Immediately following their exposure, however, the animals were 
again placed into the maze, but now with the partitions removed 
and one arm changed in brightness—for example, to white. Under 
these conditions, the animals reliably chose the changed or “novel” 
arm. 

A more subtle response to novelty or change was demonstrated 
by Dember [6] and later replicated by Fowler (1958) and Woods 
and Jennings (1959). The procedure employed in these studies was 
similar to that used by Kivy et al. (1956): rats were exposed to the 
goal arms of a T or Y maze but prevented from entering them. With 
the initial exposure, one arm was white and the other black, but 
upon reexposure, when the animals were permitted a choice, both 
arms were of the same brightness—either black or white. Even 
though the animals were now forced to make a choice between two 
equally familiar brightnesses, they reliably chose the arm that had 
been changed. As such, these data demonstrated that, in addition 
to the animal’s response to novelty, it would also respond to a 
change in the pattern of stimulation to which it had recently been 
exposed. , 

The results obtained with measures of the time that animals spent 
investigating—that is, sniffing or manipulating—various patterns or 
objects were in accord with those obtained from choice procedures. 
For example, Williams and Kuchta (1957) permitted rats to explore 
freely a black Y maze over a number of daily sessions. Subsequently, 
changes were introduced: in one experiment, one arm of the maze 
was changed to white; in another, unfamiliar stimulus objects were 
introduced into one arm. In both experiments, the animal spent 
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more time investigating that arm in which the change had been 
introduced. Similar results, based on a measure of the time spent 
investigating, were also obtained for rats by both Berlyne (1950) 
and Berlyne and Slater (1957). 

A response to novelty or change was also noted with “activity” 
measures of exploratory behavior, or the number of maze units tra- 
versed by the animal in a given period of time. Although these 
measures seemed somewhat insensitive in that it was questionable 
whether the animal traversing the greater number of maze units had 
a stronger “exploratory tendency” than one stopping at each unit 
to investigate it more thoroughly, a regularity of locomotor responses 
was reported. Rats in a checkerboard maze showed “random se- 
quences of turns, but ordered sequences of locomotor responses, 
i.e., they tended to traverse that part of the maze occupied least 
recently.” ë Thus with this measure or test situation, the response 
to novelty or change was reflected in the animal’s tendency to avoid 
that unit of the maze that was familiar to it or, conversely, to ap- 
proach that unit that was novel or unfamiliar, 

In addition to their response to novel or unfamiliar stimuli, ani- 
mals also showed a preference for “complex” stimuli. Dember "Earl 
and Paradise (1957) found that when rats were given secess to 
two contiguous circular pathways differing in visual complexity— 
for example, a homogeneous black versus a striped black-white 
one—the animals tended to select the latter, more “complex” unit. 
In addition, shifts in preference for the alternatives were always 
toward the one providing greater complexity, Thus ‘if, the rat 
initially selected the more complex unit, it spent most of its allotted 
time investigating that unit; but if it initially selected the less com- 
plex alternative, it subsequently shifted its preference (as indicated 
by the time spent investigating) to the other, more complex alterna- 
tive. 

Similar results were also obtained in an extensive study by Ber- 
lyne (1955). His test situation consisted of a square enclosure in 
which both novel and familiar stimulus objects were introduced 
Rats spent more time investigating that part of the arane 
providing numerous and complex stimuli and more time investi- 
gating novel rather than familiar stimuli. 

e K, C. Montgomery, “The Relationship Between Ex 


Spontaneous Alternation in the White Rat,” Journal of C % z 
Togan ighology 1981, "tn 580 and export’ cpartie and Physio: 
to Spontaneous Alternation in a Series of Maze Exposures,” Tot a ts Relation 
tive and Physiological Psychology, 1952, 45, 50-57. » Journal of Compara- 


ploratory Behavior and 


The Nature of Exploration 27 


Response Strength and Magnitude of Stimulus Change 


The dependency of exploratory behavior upon novelty, change, 
and complexity suggests that the strength of this behavior should 
vary with the degree of novelty and complexity or the magnitude 
of the change in stimulation confronting the animal. To test this 
notion, the author (unpublished study) confined rats for a short 
duration in one arm of a Y maze and then permitted them a choice 
between the two alternatives, one of which was the exposure arm 
and the other of which differed in brightness, ranging from black 
through dark and light gray to white. Not only did the rats show a 
reliable preference for the arm to which they had not been exposed, 
but in addition, their preference for the unfamiliar arm was positively 
related to the magnitude of the brightness difference between the 
two alternatives. 

A similar test was reported by Dember and Millbrook (1956). 
Rats were exposed in the choice-point region of a Y maze, but pre- 
vented from entering the goal arms, one of which was gray and the 
other a different brightness—for example, black. Following this 
initial exposure, the rats were permitted a choice between the two 
arms that were then of the same brightness, but both different in 
brightness from the initial exposure condition. Thus the rat was 
faced with making a choice between two changes, one greater than 
the other—for example, a gray to white change versus a black to 
white change. As in the above study, the animals reliably selected 
the arm providing the greater change. 

The effect of degree of novelty or magnitude of stimulus change 
was also demonstrated with activity or locomotor measures of 
exploration. Montgomery [4] permitted different groups of rats to 
explore an H-type maze and then, several minutes later, another 
that differed in brightness, ranging from black through gray to 
white. The results of this study showed that exposure to the first 
situation produced a decrement in the amount of exploration of 
the second, and further, that this decrement was positively related 
to the degree of similarity between the two test situations. Thus the 
dependency of exploration on the degree of novelty, or the magni- 
tude of change in stimulation, was indicated in two ways: with the 
general reduction or decrement in the amount of exploration of the 
second, basically similar situation, and with less of this reduction 
taking place in the second situation when it was more dissimilar in 
brightness to the first. 

With several of the studies noted (for example, Berlyne, 1950, 
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1955; Montgomery, 195la, 1952b, [4]), the relationship between 
strength of exploration and magnitude of stimulus change was 
investigated in still another way: simply by extending the animal’s 
exposure to the novel or unfamiliar stimuli present. With this 
arrangement, the animal’s exploration markedly declined over the 
time of its exposure to the novel stimuli or the unfamiliar maze 
situation, indicating that as these stimuli or situations were explored 
and presumably became less novel, offering less of a change in the 
animal’s pattern of stimulation, the strength of the animal’s explora- 
tory response also declined. In line with these observations, it was 
also noted that when the animal was removed from the test situa- 
tion, following extensive exposure to the novel stimuli therein, and 
then returned the next day, exploration recovered to its original 
strength. Presumably, as the investigated and thus familiar stimuli 
became novel or unfamiliar once again, through the animal’s lack 
of exposure to them, exploration also recovered. Both of these effects 
—the decrement in exploration that resulted from extended exposure 
and the recovery of exploration that followed nonexposure to a 


novel situation—were also obtained over repeated, daily test sessions 
(for example, Berlyne, 1950, 1955). 


Toward an Empirical Tenet 


Collectively, the early studies on exploration achieved two ends: 
first, through the variety of measures and test procedures that they 
employed, the general and initially vague term of exploration was 
given specific reference to such behaviors as orienting or locomoting 
toward, investigating, sniffing, and manipulating particular objects 
or patterns; secondly, the findings of these studies demonstrated that 
an animal would explore a stimulus object or pattern to the extent 
that it was novel, unfamiliar, complex, or provided a change in the 
animal’s present or recent pattern of stimulation. These findings are 
not limited in their generality by the fact that the specific investiga- 
tions cited above used visual forms of stimulation primarily or dealt 
with rats as subjects. The effectiveness of changes in visual, audi- 
tory, and kinesthetic stimulation in eliciting and maintaining explo- 
ration in rhesus monkeys and chimpanzees was also studied and 
rather extensively (for example, Butler and Alexander, 1955; Butler 
and Harlow, 1954; Harlow, Blazek, and McClearn 1956; Welker, 
1956a, 1956b, 1956c). And, with these primate studies comparable 
results were obtained. For example, the studies by Welker showed 
that the introduction of novel stimuli or stimulus objects effected 
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increased responding (Welker, 1956b), and that behavior changes 
were more frequent in complex than in simple situations, with 
irregular objects or patterns being approached more frequently 
than symmetrical ones (Welker, 1956c). 

Taken together, both the rodent and primate studies provide a 
common basis for the formulation of a simple, yet generally descrip- 
tive or summarizing tenet: the animal will respond to (that is, 
explore, in the sense described above) a change in the complex 
and/or pattern of stimuli presently or recently impinging upon it, 
and within limits, the strength of its exploratory response will be 
greater, the greater the extent or the magnitude of the change in 
stimulation. This empirical tenet (or law) describes a relationship 
that is of particular significance for theoretical accounts of explora- 
tion; however, before consideration can be given to this relationship 
and its significance, some comment must be offered on the form 
of its statement. 

First, it should be recognized that the term change has broad and 
inclusive reference to the variables of novelty and unfamiliarity and, 
in addition, to that of complexity and even to other factors, such as 
surprisingness, incongruity, asymmetry, and so on, which have also 
been cited, but more recently, as effective determinants of explora- 
tion (see Berlyne, 1960). In other words, the effects of all of these 
variables or factors in eliciting exploration are subsumed, by defini- 
tion, under a broad or generally descriptive response-to-change 
effect. As an aside, it should be noted that these factors may also 
be theoretically subsumed under the stimulus-change variable. For 
example, with a complex stimulus configuration, such as a striped 
black-white pattern, the animal encounters features of change by 
way of its commerce with the variety of stimulus elements com- 
prising the pattern—that is, by the animal’s visual scanning of first 
black, then white, then black, and so on. As such, the complex, 
asymmetrical, or incongruous configuration or pattern may be 
viewed as a composite of stimuli that provides numerous features 
of change. 

A second consideration, relating to the empirical tenet, is the 
qualifying phrase within limits employed in stating a positive rela- 
tionship between the magnitude or the extent of the change in 
stimulation and the strength of the exploratory response elicited 
by the change. Although this relationship derives from the finding 
that the exploration is more pronounced, the greater the dissimi- 
larity between the presently or recently impinging stimuli and the 
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novel stimulus introduced, it is not to be anticipated that far greater 
or more radical changes will increase exploration even more. We 
may expect, for example, that an animal in a darkened situation will 
explore a very weak source of light, and further, that the strength 
of its exploratory response will be greater with a mild or moderate 
brightness of light, but not if the light is too intense. The fact that 
bright lights and, similarly, loud noises elicit escape or withdrawal 
reactions provides, in part, the basis by which contemporary drive 
theorists posit intense external forms of stimulation as drive-defin- 
ing conditions. Aside from the effect of too intense a stimulus, 
however, some findings also indicate that a change in stimulation 
that is “too” novel, in the sense of being strange, bizarre, or unex- 
pected, may elicit fear and thereby reduce or even preclude explo- 
ration, at least as long as the fear persists. A good example of this 
effect would be the “spontaneous fears” that Hebb’s [13] chimpan- 
zees exhibited at the sight of a stranger, an anesthetized body of a 
fellow chimpanzee, or even a clay model of a human’s head. These 
findings and those noted in regard to the effects of intense stimulation 
seem to require that reference be made to the factors or determinants 
of exploration as “mild” or “moderate” changes in stimulation, 
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and intense stimulation such as Strong electric shock elicits escape 
or withdrawal reactions, so similarly does a mild or moderate change 
in stimulation elicit exploration. Furthermore, the behavior involved 
in each of these relationships is stronger or more vigorous with 
increasing magnitudes or intensities of its eliciting stimulus. In other 
words, larger amounts of food elicit more chewing, salivating, and 
so on; more intense shock elicits more vigorous lurching, jumping 
about, withdrawing, and so on; and similarly, but within limits, a 
greater change in stimulation elicits more investigating, sniffing, 
manipulating, and so on. These points of similarity among appeti- 
tive, escape, and exploratory behaviors suggest that the contribution 
of the early studies on exploration related primarily to the isolation 
of another type of unconditioned stimulus (or UCS)—that is, one 
that could elicit the unconditioned response (or UCR) of explora- 
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tion. It is, indeed, noteworthy that this relationship, between a 
change in stimulation and the orienting or “investigatory reflex” 
that it elicits, was first uncovered some quarter of a century earlier 
by Pavlov (1927). 

On the basis of the analogous UCS-UCR relationships existing 
for appetitive, escape, and exploratory behaviors, it would seem that 
the process underlying the initiation or arousal of exploration should 
be comparable to that underlying the other behaviors, and further, 
that this motivational process for exploration should have similar 
kinds of defining conditions, But this presents a problem. For con- 
temporary theorists, the initiation or arousal of escape behaviors is 
attributed to the intense stimulus—for example, strong electric shock 
—serving as the UCS; on the other hand, the arousal or activation 
of appetitive behaviors, such as eating, relates not to the UCS of 
food but rather to the condition of food deprivation. This problem 
of choosing the “appropriate” model seems not to have been ex- 
plicitly recognized by the early investigators of exploration. Never- 
theless, the variety of theoretical accounts that they offered were 
divided on exactly this basis; and thus two camps may be recog- 


nized. 


The Concepts of Curiosity and Boredom 

One group of theorists simply maintained that external forms of 
stimulation that were both mild and novel motivated the animal 
to explore and investigate these forms of stimulation. The animal 
became “curious” of the novel or unfamiliar stimuli and, hence, 
responded to them. This view, in which the novel stimulus (UCS) 
not only directs but also activates or energizes the behavior is 
clearly exemplified in Berlyne’s (1950) early account of exploration: 
“When a novel stimulus affects an organism’s receptors, there will 
occur a drive-stimulus-producing response . . . (which we shall 
call ‘curiosity’). . . . As a curiosity arousing stimulus continues to 
affect an organism’s receptors, curiosity will diminish.” 7 

The theoretical accounts of exploration noted previously for both 
Montgomery [4] and Harlow (1953b) were very similar, if not 
identical, to that espoused by Berlyne (1950). Montgomery [4] 
simply hypothesized that “. . . a novel stimulus stiuation evokes in 


7D. E. Berlyne, “Novelty and Curiosity as Determinants of Exploratory 
Behavior,” British Journal of Psychology, 1950, 41, 79; “The Arousal and Satia- 
tion of Perceptual Curiosity in the Rat,” Journal of Comparative and Physio- 
logical Psychology, 1955, 48, 238-241. 
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an organism an exploratory drive. . . .”® Moreover, like Berlyne, 
Montgomery assumed that the strength of the exploratory (or curi- 
osity) drive would decrease with time of continuous exposure to 
the novel stimulus situation and then recover during a period of 
nonexposure. Harlow, on the other hand, in voicing an objection 
to the tendency of contemporary theorists to view all behaviors as 
dependent upon “homeostatic” drives, argued that a manipulation 
motive (Harlow, 1950) and a visual exploration drive (Harlow, 
1953b ) were but several of a class of externally elicited or “extero- 
ceptively aroused” drives that impelled behaviors such as investi- 
gation, manipulation, and the like, 

In contrast to proponents of the “curiosity” concept, other the- 
orists maintained that animals became “satiated” or “bored” with 
stimuli to which they had been or were being exposed, and thus 
responded to other stimuli that were novel or unfamiliar, For these 
“boredom” theorists, then, it was the famil 
of the animal's present or recent surround t 
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tion that served as the contemporary drive theorists’ rebuttal to the 
criticisms that had been posed by both Harlow ([3], 1953b) and 
Montgomery (1954). Satiated with certain stimuli, the animal 
would respond to other, more novel stimuli, and thereby encounter 


additional stimulation, but this change in stimulation would reduce 


the drive that resulted from the stimuli with Kich ihe eaten’ econ 
satiated or bored. 


Very similar to the notion of a boredo: 


iar or unchanging stimuli 
hat motivated exploration 
unfamiliar stimuli simply 
avior. This viewpoint, in 
xploration is treated in a 
nd thirst, was first given 
uli that were homogeneous, 
evoked a boredom drive 
It was this conceptualiza- 


m drive was the concept of 
er [5]. Basic to Glanzer’s 


S a Function of ‘Similarity’ of 
and Physiological Pagcheloey, 


xplanation of Spontaneous Alterna- 


tion and Related Phenomena,” Psychological Review, 1953, 60, 259. Italics 


omitted. 


The Nature of Exploration 33 


reduces the organism’s tendency to make any response to A, those 
stimuli to which the organism had not been or was less satiated— 
that is, the novel or unfamiliar stimuli—elicited responses of ap- 
proach and investigation. In view of the fact that this concept of 
satiation (or boredom) was of an opposed emphasis to that of 
curiosity, it is interesting to note that stimulus satiation was assumed 
(conversely) to increase with continued exposure to a stimulus ob- 
ject and to decrease or dissipate with nonexposure. 

It should be made clear that, even though the early theorists 
stressed either boredom or curiosity as the motivational processes 
underlying exploration, an equally plausible account of this behav- 
ior might entail both concepts or, at least, certain aspects of each. 
Indeed, there was suggestion of such an admission within the curi- 
osity camp. Montgomery (195la) wrote of the rat tending “to avoid 
that place it has traversed last” and Berlyne (1950) spoke of the 
“urge to escape from monotony and boredom.” In fact, quite re- 
cently, Berlyne (1960, 1963) has offered a theory of “optimal stimu- 
lation” or “arousal” in which the concepts of boredom and curiosity 
are viewed as the animal's drives to terminate or reduce conditions 
of high arousal potential, such as very monotonous or perceptually 
ambiguous ones. A similar theory based on the concept of optimal 
stimulation or arousal has also been posited by Fiske and Maddi 
(1961). These more recent formulations of exploration will be 
examined in Chapter IV; for the present, it is more than sufficient 
to treat the early conceptualizations of exploration and the problems 
that they engendered. 


Logical Status of the Concepts 

At the beginning of this chapter, note was given to the fact that 
both Harlow (1953b) and Montgomery [4] reacted to the inade- 
quacies of contemporary theory not by proposing or developing new 
conceptualizations but simply by extending the existent concept of 
drive. Having reviewed the other theoretical accounts of exploration 
initially offered, we may note further that all, save one, of the “new” 
conceptualizations were, in fact, drive concepts. Only Glanzer’s [5] 
concept of stimulus satiation was without a drive or energizing 
function; instead, it had a “decremental” or inhibitory property. 
Continued exposure to a given stimulus produced only a decre- 
ment in the animal’s tendency to respond to that stimulus. In this 
sense, Glanzer’s conceptualization adequately described a mecha- 
nism by which the animal would select a novel stimulus over a 
familiar one, but it failed to account for the arousal or occurrence 
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of the behavior. The animal could have a tendency to respond to 
some novel stimulus because of satiation to some other, familiar 
stimulus, but this did not provide the means by which the animal 
would exhibit the tendency. As such, Glanzer’s formulation repre- 
sented only a partial treatment of the problems entailed in account- 
ing for the variability of exploration. 

It should be noted, however, that Glanzer actually molded his 
stimulus satiation concept after another prominent “decremental” 
notion, Hull’s (1943) concept of reactive inhibition, or “fatigue.” 
This concept also served in a decremental capacity in the sense that 
it reduced the potential of the reaction or response in which it was 
based; nevertheless, the concept was conceived and endowed with 
drive functions. It would appear, then, as Fowler (1963) has re- 
cently suggested, that drive or energizing properties may also be 
ascribed to the satiation concept. This issue aside, however, we may 
treat the early theoretical accounts of the arousal or motivation of 
exploration as relying solely on the drive concept, one which was 
defined by the curiosity theorists in terms of novel or unfamiliar 
stimuli, and by the boredom theorists in terms of the animal's 
exposure to familiar or unchanging stimuli. And with these defining 
conditions at hand, we may now consider the adequacy of the 


exploratory-drive concept and also those Previously cited criticisms 
of it. 
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Glanzer’s satiation concept accomplished the former but not the 
latter. In addition, and most important, it is necessary to demonstrate 
that the concept employed is, in fact, meaningful—that is, that the 
functions ascribed to the concept are adequately reflected in the 
behavioral events produced by the conditions that define the con- 
cept. As motivational or drive concepts, then, both the curiosity and 
boredom notions could be made meaningful only in terms of be- 
havioral events that reflected the functions commonly attributed 
to drive-motivational notions. Hence, it had to be demonstrated 
that the exploratory drive could (a) energize those responses that 
were innately associated with or previously conditioned to the stim- 
uli confronting the animal, and (b) provide a basis for the learning 
(reinforcement or strengthening) of new associations between the 
impinging stimuli and the responses that led to a reduction of this 
drive, 

Viewed in terms of these criteria, the concept of an exploratory 
drive received little, if any, support from the early studies of ex- 
ploration. By demonstrating that animals would respond to a mild 
or moderate change in stimulation, these studies indicated the need 
for a conceptual process by which the arousal or initiation of explo- 
ration could be explained. However, the findings from these studies 
could not provide independent support for the exploratory-drive 
concept, because this concept was posited on the basis of them. 
Fortunately, the concept was to receive independent verification 
with other findings that seemed to satisfy the criteria noted, Along 
with the previously cited investigations, there occurred, at about 
the same time, a sizable number of studies that demonstrated that 
animals would learn to perform responses that were instrumental 
to a change in stimulation. To put it simply, and perhaps more suc- 
cinctly, these studies indicated that, aside from the animal’s response 
to a change in stimulation, it would also learn to respond for the 


change. 


Empirical Support: Response for Stimulus-Change Reinforcement 


In the context of visual-locomotor exploration, Myers and Miller 
[7] found that rats satiated for food and water would learn to 
press a bar in a shuttle box in order to gain entry into a black 
compartment from a white one, or vice versa. On the other hand, 
animals that were not permitted to see into or enter the other 
compartment with their bar-press responses did not learn. Similarly, 
Chapman and Levy (1957) observed that visual changes in the goal 


36 Inquiry and Argument 


box of a straight alley or runway would reinforce or increase rats’ 
running speeds. 

A number of investigations also demonstrated that rats would 
learn a bar-press response when it was followed either by weak 
light-onset (for example, Girdner, 1953; Hurwitz, 1956; Marx, 
Henderson, and Roberts, 1955; Robinson, 1959, 1961) or by weak 
light-offset (for example, Hefferline, 1950; Roberts, Marx, and Col- 
lier, 1958; Robinson, 1961). Moreover, with other studies (for 
example, Barnes and Baron, 1961b; Kish, 1955) it was shown that 
the number of trials or responses to extinction y 


was generally greater, 
the greater the number of light-onset reinforcements presented 
during acquisition training. 


The reinforcing effect of weak light-onset could not be dismissed 
on the basis of the possibility that it heightened the animal's activ- 
ity, and thereby produced a greater frequency of “accidental” bar 
presses. In a study by Kling, Horowitz, and Delhagen (1956), two 
groups of rats were run in pairs: for the ani 
onset was contingent upon a bar-touch response, but for those of 
the other group, light-onset occurred whenever the animals of the 
former group responded and received the light. When the light 
stimulus was introduced after a period of o 
bar-touch, light-contingent animals showed 
increment in response frequency than did th 
for which light-onset was not contin 


mals of one group, light- 
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switched to the other arm, Subsequently, Montgomery and Segall 
(1955) demonstrated that rats would learn a black-white discrimi- 
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nation in a Y maze for exploration of a checkerboard maze. And in 
line with these findings, Forgays and Levin (1959) showed that rats 
would learn a discrimination habit in a double bar-press situation 
and then a reversal when weak light-onset served as the reinforcer. 

Studies of the effect of exploratory incentives on the performance 
of monkeys yielded comparable results. As with rats, bar pressing 
by monkeys could be reinforced by a change in illumination, and 
irrespective of the direction of the change—that is, either an increase 
or a decrease in brightness (Moon and Lodahl, 1956). These ani- 
mals would also learn a position discrimination when visual explo- 
ration served as the incentive (Butler, 1953) or when correct 
responses were followed by 15 seconds of sound emitted from a 
monkey colony (Butler, 1957a). In line with these observations, 
Harlow and McClearn (1954) reported that monkeys would show 
improvement in discrimination problems on the basis of manipu- 
latory incentives, and as noted previously, the solution of complex 
mechanical puzzles could be learned by these animals for no other 
incentives than those provided by manipulation of the puzzle de- 
vices themselves (Harlow, 1950). 

The reinforcing nature of a mild or moderate change in stimula- 
tion is clearly indicated in the results of the above class of studies: 
particular responses are progressively increased in strength over 
successive trials or days of trials, maintained with considerable 
strength, and then gradually extinguished with removal of the 
stimulus consequence or change employed as the reinforcer. That 
these changes in stimulation served to reinforce rather than simply 
elicit the response in question—that is, that the animals responded 
for rather than simply to the change—is evident in the fact that the 
responses observed in these studies were instrumental to the change 


in stimulation offered as an incentive. 


Some Insights and Additional Problems 

The findings of the “reinforcement” studies were significant in 
several respects. By showing that mild or moderate changes in 
stimulation could serve as conditions of reinforcement, they indi- 
cated that these changes in stimulation constituted the goal or 
incentive condition underlying exploration. With these findings, 
then, and also those previously noted on the response-to-change 
effect, a “definition” of exploration seemed complete. Comparable 
to the study of food-seeking or escape behaviors, a study of explora- 
tion entailed observing and measuring the effects of particular 
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conditions or factors on those responses—for example, bar press, 
running, and so on—that were instrumental to this goal condition 
of a change in stimulation, and also those consummatory responses 
—that is, the exploratory responses of orienting, investigating, and 
so forth—that were elicited by this goal condition, 

The above class of studies were also quite significant in view of 
the empirical support that they afforded the concept of an explora- 
tory drive. By showing that a variety of responses—bar press, 
runway, choice, and so on—could be initiated, reinforced or strength- 
ened, maintained, and then terminated, these findings seemed to 
satisfy both of the previously noted behavioral criteria by which 
drive concepts are typically assessed. But in doing so, they also 
demonstrated that the curiosity formul 
According to the curiosity theorists, 
elicited by the impingement of novel 


ation was severely wanting. 
the exploratory drive was 
or unfamiliar stimuli on the 


led to them. That is, the animals began working. 
the bar, and so on—for the novel sti 
these stimuli. Hence, as Brown (1953a, 1961) cogently argued, if 
novel or unfamiliar stimuli elicit the exploratory drive, this drive is 
not produced until after the animal has made the response the 
drive is supposed to be motivating, 
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that were noted above and to which fuller consideration will be 
given in Chapter IV. 

As a final word, it should be made explicit that the above noted 
paradoxes, and the theoretical developments that they subsequently 
fostered, related not to the inadequacies of the boredom or satiation 
concept offered by the contemporary drive theorists but rather to 
the theoretical difficulties that confronted the curiosity conceptuali- 
zation. The findings from the reinforcement studies served only to 
bolster the boredom formulation, and in this regard, it was some- 
what ironic that these findings, which initially called into question 
the adequacy of contemporary drive theory, seemed only to be ade- 
quately explained by the extended formulation that the contempo- 
rary drive theorists had proposed. 
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vides not only a resolution of the paradoxes that plagued their con- 
ceptualization but, in addition, a basis for integrating the seemingly 
opposed concepts of curiosity and boredom. 


A Drive-INcENTIVE FORMULATION 

According to both Hull (1952) and Spence (1956), perform- 
ances, such as bar pressing, running, or choosing, which are instru- 
mental to a particular goal object or incentive, like food, will be 
motivated not only by the animal’s drive—that is, condition of food 
deprivation—but also by the goal object or incentive itself. The 
manner in which the food incentive may exert a motivational effect 
on instrumental performances is quite intricate, but in short, this 
effect results from the animal learning to “anticipate” or “expect” 
the incentive. Because the particular mechanism that underlies the 
animal’s learned anticipation of the food incentive is comparably 
intricate, its operation can best be illustrated with the following 


diagram, 
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This diagram provides a symbolic representation of the stimulus- 
response associations that may occur in a “chain” or sequence of 
instrumental behavior, such as that exhibited in a straight alley or 
runway where, for example, a hungry animal learns to run for food. 
The diagram illustrates that, in reaction to the composite of external, 
physical stimuli at the start of the alley (CSa), the animal begins to 
run (R;), as a result encounters additional alley stimuli (CSa), 
continues running (Ri) and so on, until it reaches the goal end of 
the alley, where it obtains the food (UCS) and engages in the goal 
response of eating (Rx). With its eating of the food, the animal also 
experiences the stimulation (S,) that is characteristic of the goal 
response—for example, taste sensations and sensory feedback from 
chewing, salivating, and ingesting. 

The motivation relating to the incentive or UCS of food in the 
above diagram is presumed to result indirectly from the classical 
conditioning of the goal response (Rg) to those alley stimuli (CS’s) 
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that the animal experiences prior to its receipt of food on each trial. 
With this conditioning, which may be of the trace, delay, or simul- 
taneous variety, the goal response will occur (as indicated by rg) 
when the animal is both near to and far removed from the goal; 
however, in becoming anticipatory—that is, in antedating the 
occurrence of the food—the goal response will have only a frac- 
tional form (hence, “little” R, or simply rg), because without food 
in the animal’s mouth, salivation and chewing movements can occur, 
but not ingestion. With the occurrence, then, of this fractional, 
anticipatory goal response (r), and also its characteristic stimula- 
tion (s,, sensory feedback from anticipatory salivation and chewing 
movements), the instrumental running response (R,) will be 
affected in two ways. As a result of its close temporal association 
with sg, R; will become conditioned to Sg, and correspondingly, its 
strength will be directly affected by the amount or intensity of this 
stimulation. It is in this intricate manner that the incentive-motiva- 
tional concept works like the familiar drive-motivational concept, 
energizing or intensifying instrumental response tendencies. How- 
ever, unlike the drive concept, which is operationally defined in 
terms of the amount or length of food deprivation, the incentive- 
motivational concept is operationally defined in terms of the magni- 
tude—for example, size, weight, or amount—of the food object, 
because it is this feature of the incentive that influences the strength 


and vigor of the goal response, its r,s, component, and hence the 
strength and vigor of the instrumental response, 


Curiosity as an Incentive-Motivational Construct 


In the context of exploratory behavior, the curiosity construct 
may be conceptualized in a similar fashion. That is, “curiosity” may 
be viewed as the animal’s “learned anticipation” of the novel or 
unfamiliar stimuli that it experiences upon performing some instru- 
mental response. Correspondingly, the motivation stemming from 
curiosity, or the animal’s anticipation will relate to the novel or 
unfamiliar stimuli serving as incentives, With this conceptualization, 
a basis is provided for the drive-incentive or boredom-curiosity 


formulation suggested previously, Specifically, drive motivation 


(boredom) may be defined in terms of the animal’s length of 


exposure to or “familiarity” with a relatively unchanging stimulus 
condition, or conversely, in terms of the animal’s length of depriva- 
tion of a change in stimulation. Incentive motivation (curiosity), on 
the other hand, may be defined in terms of the magnitude of the 
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exploratory incentive—that is, the magnitude of the change in stimu- 
lation that the animal experiences upon performing some instru- 
mental response for stimuli that are novel, unfamiliar, and so on. 

. It would be sufficient to treat “curiosity” as an incentive-motiva- 
tional construct and simply describe its defining condition as above, 
without making specific reference to any underlying mechanism— 
for example, rz-S;. However, in order to complete satisfactorily the 
analogy being drawn between exploratory and appetitive motiva- 
tion, specification of the goal response and its fractional, anticipa- 
tory component should also be required in the case of exploration. 
This might appear difficult, because a clearly definable goal object 
(UCS) and goal response (R,), such as food and eating in the case 
of appetitive behavior, seem not to be had with exploration. But 
as ‘was pointed out in the previous chapter, the functional relation- 
ships existing between a change in stimulation and the exploratory 
response that it elicits are quite analogous to those between the 
UCS of food and the UCR (or Rg) of eating. Furthermore, the find- 
Ings reviewed in that chapter showed that a change in stimulation 
served as a goal or incentive condition in the sense that the animal 
learned to perform responses that were instrumental to this condi- 
tion. On the basis of these considerations, it may be argued that 
the consummatory or goal response in the context of exploration is 
One and/or all of the components of seeing, looking, and orienting 
—that is, the exploration or response to change itself. Because the 
components of this type of goal activity can relate to changes in the 
Sense organs, in the skeletal muscles controlling them, and/or in 
the general skeletal musculature, specific examples of such changes 
would include dilation of the pupil, photochemical activity, an 
opening of the eye, specific head turning and general movements 
toward the source of stimulation, a pricking up of the ears, snif- 
fing, a rise in general muscle tonus, and so forth (see Berlyne, 
1960). 

It follows from our treatment of inc 
specific goal activities noted above may 
stimuli temporarily preceding them and 
identical, to the classical conditioning © 
such as chewing, salivating, and so on. This contention is supported 
by the Russian literature, which, as reviewed by Berlyne (1960, 
1963), has shown that, when one stimulus (a CS) repeatedly pre- 
cedes another, the first will come to elicit anticipatory receptor 
adjustments—for example, orienting responses—appropriate to the 


entive motivation that the 
become conditioned to the 
in a manner similar, if not 
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second stimulus. This being the case, fractional components of this 
goal or orienting activity may occur in monotonous or perceptually 
restricted surrounds, antedating the occurrence of the novel or 
unfamiliar stimulus objects serving as incentives. Herein lie the 
means, then, by which the “bored” animal can also become “curi- 
ous,” can learn to anticipate the change in stimulation contingent 
upon some instrumental act. With this formulation, one may begin 
to speak more precisely of the motivational increments stemming 


from “curiosity” or the expectation of seeing, investigating, and so 
forth. 


Response Strength and Amount of Stimulus-Change Deprivation 

When the above interpretation was first presented (Fowler, 
1959) at the Eastern Psychological Association meetings, relatively 
few studies especially pertinent to the formulation were available. 
Nevertheless, these studies, which differ by way of their parametric 
nature from those treated in Chapter II, were quite supporting of 
both the drive (boredom) and incentive (curiosity) constructs. In 
reviewing these studies, we shall consider first those that have 
reference to the boredom construct, on the basis of which it is 
posited that the strength of a response to or for a change in stimula- 
tion is a positive function of the organism’s length of exposure to a 
relatively unchanging stimulus condition, or conversely, its length 
of deprivation of a change in stimulation, 

In one of the earliest of these studies, conducted in the context 
of alternation behavior, Glanzer (1953b) found that when rats 
were exposed to one arm of a T maze and then permitted to choose 
between the arms, their tendency to alternate or select the unfa- 
miliar arm was greater when their exposure to the other arm lasted 
15 or 30 minutes than when it lasted for only one minute. Related 
to this finding is the general observation that rats’ preference for 
either arm of a T or Y maze, prior to any exposure at all, is typi- 
cally within the limits of chance expectancy (Dember and Fowler, 
1958). Another study (Darchen, 1957), 


J c although not within the 
context of alternation behavior, offers similar results. Cockroaches 


were found to be more prompt in their investigation of a colored 
cube when it was introduced after the animals had 30 minutes ex- 


posure to an empty kog than when they had only 15 minutes 
exposure to the box. 


In Glanzer’s (1953b) study, it is possible that the rats with the 
longer exposures were more highly motivated to avoid the confines 
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of their surround rather than its “monotonous” stimulation; hence, 
they may have selected the unfamiliar alternative in search of less 
restriction. To assess independently the effect of length of exposure 
on alternation behavior, the author (unpublished study ) confined 
different groups of rats for the same length of time to one arm of a 
T maze, but varied their length of exposure to the particular bright- 
ness of the arm, either black or white, by having the animals ini- 
tially view inserts of a mid-gray brightness for different portions of 
their five-minute confinement. When the rats were then permitted 
to choose between the black and white arms, following either 0, L 
2, or 4 minutes exposure to black, for example, their selection of the 
white arm was significantly greater the longer their exposure to 
black. 

A positive relationship between the le 


to a particular stimulus condition and 
mental response for stimulus change was also demonstrated; and in 


contexts where the possible effect of a confinement factor seemed 
precluded by the nature of the response measured. In a study by 
Butler [8],! for example, rhesus monkeys were individually con- 
fined in a chamber and deprived of varied visual experience for 
0, 4, or 8 hours. When the animals were then permitted to make a 
panel-pushing response in order to view (through a small opening ) 
the room outside of the chamber, the frequency of their responses 
was greater the longer their visual deprivation. 

Similar findings have been obtained for rats, when a weak change 
in illumination serves as the incentive. Robinson (1957) has shown 
that illumination level during the animal’s adaptation to a modified 


Skinner box is a signficant determinant of the strength and reliability 
of its subsequent bar pressing for additional light stimulation. And 


in a perhaps more relevant study, Premack, Collier, and Roberts 
(1957) report that frequency of. bar pressing for weak light-onset 
is positively related to light deprivation over 12-, 24-, and 48-hour 
periods. On the basis of their results, these authors suggest, in 
accord with the drive construct outlined above, that “the use of 
concepts such as novelty or curiosity to explain the reinforcing 
effects of puzzles, etc., is misleading. Rather, these effects are better 
treated as a drive for stimulus change. . - - 


ngth of an animal's exposure 
the strength of its instru- 


»2 


1 Bracketed numbers refer to readings in Part Two. 

2 D, Premack, G. Collier, and C. L. Roberts, “Frequency of Light-Contingent 
Bar Pressing as a Function of the Amount of Deprivation of Light,” American 
Psychologist, 1957, 12, 411. Italics added. 
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Response Strength and Amount of Stimulus-Change 
Reinforcement 


Supporting evidence for the drive-incentive formulation is also 
obtained in the case of the curiosity construct, which posits that, 
within limits, the strength of the animal’s response for stimuli that 
are novel, unfamiliar, and so forth, will be positively related to the 
magnitude or extent of the change in stimulation afforded by these 
stimuli. In a study of the effects of various “incentive” conditions 
on the visual exploration of monkeys, Butler (1954) found that 
frequency of bar pressing was greater, in ascending order, with 
the following conditions: the monkey's viewing from a constant 
visual environment (a) an empty incentive chamber, (b) an array 
of foods, (c) a moving electric train, or (d) another caged monkey. 
Although it is difficult to assign ordinal values to these different 
“incentive” conditions, it would appear that the amount of stimulus 
change afforded by them increases in accord with their specified 
order. 

More substantial evidence in support of the curiosity or incentive- 
motivational construct is obtained with parametric investigations 
bearing on the reinforcing properties of weak light-onset, Levin and 
Forgays [9] studied the effect of the intensity (or extent?) of this 
type of change in stimulation on an instru 
by rats and found that, within the rang 
responding was greater the higher the in 
contingent upon the rat’s response. (Thi 
nonmonotonic for younger rats, indicati 


younger animals, the highest light intensity was somewhat aversive. ) 
Similar results have also been obtained by Stewart (1960); with a 
fixed-ratio schedule of reinforcement, and especially as the ratio 
increased, rates of bar pressing by rats were higher, the greater the 
intensity of weak light-onset employed. 

Although the above studies have demonstrated a positive rela- 
tionship between instrumental response strength and the magnitude 
of the change in stimulation provided as an incentive, one cannot 
be certain that it is the extent of the change that is reinforcing rather 
than the particular intensity of the stimulus consequence; both the 
extent of the change in and intensity of illumination are confounded. 
However, in view of those studies treated in Chapter II, which 
showed that such stimulus consequences as exposure to black sub- 
sequent to white and weak light-offset are also reinforcing, it 


mental bar-press response 
of intensities employed, 
tensity of light stimulation 
s relationship was actually 
ng that, perhaps for these 
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would appear that the critical or effective variable is the extent of 
the change rather than the particular intensity or brightness. This 
conclusion is also supported by the results of more recent investiga- 
tions. For example, Crowder and Crowder (1961) varied the dura- 
tion of light-onset contingent upon bar pressing by female rats and 
obtained no differences among the several experimental groups, a 
fact that suggests that the reinforcing effect of light-onset relates to 
the change from darkness to light rather than from the light itself. 
Also relevant in this context is a study by Barnes and Baron [10]. 
Lever presses by different groups of mice were reinforced by the 
Onset of different luminous patterns, namely circle, square, or X. In 
addition, a fourth group received a different one of these three 
patterns during each minute of the conditioning session. All groups 
showed increased rates of responding, with the multiple pattern 
group exceeding the circle and square groups but not the X group. 
In part, then, these data suggest that the magnitude of the rein- 
forcing effect of light-onset is related to the amount of variation or 
change provided. 

: Finally to be noted is a study that bears 
incentive constructs. Zimbardo and Miller 
compartment of a black-white shuttle box and then gave them the 
opportunity either immediately or after a two-minute delay to enter 
the other compartment. With training, the delayed animals, for 
which there presumably would be some satiation, showed faster 
running speeds, but the nondelayed animals did not. When the 
speed of delayed animals had reached a relatively stable level, the 
novelty of the apparatus was increased by the introduction of vari- 
ous unfamiliar objects into the compartments. Additional training 
under this increased incentive condition—that is, greater stimulus- 
change reinforcement—produced a substantial increment in the 
speeds exhibited by the delayed animals. 

The results of the above studies are in close agreement with the 
proposed formulation and the functional S-R relationships that it 
posits. Nevertheless, it should be recognized that these findings do 
not fully attest to the meaningfulness of the boredom (drive) and 
curiosity (incentive) constructs employed. For example, with the 
studies relating to the boredom construct, relatively long periods of 
exposure (or deprivation of a change in stimulation) were em- 
ployed. As such, the findings from these studies can only substanti- 
ate a concept of boredom that is operationally defined in terms of 
relatively long periods of exposure. 


on both the drive and 
[11] placed rats in one 
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Some evidence of the meaningfulness of the boredom construct 
would seem to be obtained, relative to the effects of short-term ex- 
posure, from the studies noted above on alternation behavior, where- 
in the exposure periods varied over minutes rather than hours. 
However, with these studies, there is an additional problem; they 
do not satisfy the behavioral criteria by which a drive concept, like 
boredom, is typically assessed. For example, it cannot be concluded 
from these studies that the animal learns a response that is instru- 
mental to the reduction of the drive (boredom) presumed to be 
operative, because subsequent to its exposure to one arm, the ani- 
mal may only be responding to and not for the unfamiliar arm. In 
other words, the stimulus change provided by the unfamiliar or 
nonexperienced arm may not have reinforced, but simply elicited 


(directed), the choice behavior of approaching and investigating 
the unfamiliar arm. 


A Current Program of Research and Some Tentative Conclusions 


In view of the limitations of the above studies, the author initiated 
a program of research in 1961, which, being guided by the drive- 
incentive formulation, was gener: 
perimental operations and stimulu 
component of exploration. Becaus 


the importance of the relationship between (a) those conditions of 


compartments of a straight all 
been directed primarily to the effect on rats’ runwa’ 


varied lengths of exposure to different intensities of visual stimula- 


brightnesses ) employed within 
the start and goal compartments, 


Due to the paucity of relevant d 
exposure, this variable was investig: 
1963), as well as in each of the o 


ata on the effects of short-term 


the goal brightness—for example, 
wall of the goal was the same brig! 
making the brightness-change rei 
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rat’s response of running to and looking inside the goal.) In addition 
to the effects of varied-start exposure, the second study assessed 
the effects of varied lengths of short-term exposure to the goal bright- 
ness; the third, the effects of different magnitudes of brightness- 
change reinforcement contingent upon the runway response (for 
example, black start to white, gray, or black goal); and the fourth, 
the effects of reversing, late in training, the lengths of start exposure 
and the amounts of brightness change at the goal that had been 
imposed upon different groups of rats earlier in their training. To 
assess the generality of the effects of the exposure and change vari- 
ables, the fifth study investigated the learning by rats of a position 
habit in an E maze—that is a T maze with the goals being perpen- 
dicular extensions of the T arms and, thus, not visible at the choice 
point. In this study, the rats were exposed on each trial for 30 or 180 
seconds to the start brightness (for example, black), prior to being 
permitted to make a choice and be exposed briefly to a goal that 
was either the same brightness as the start compartment (black) or 
a different brightness (white or gray). 

In accord with the proposed formulation, the research has shown 
that (a) rats will learn to perform responses (runway or choice) 
which are instrumental to a simple change in brightness (for ex- 
ample, running from black to white), (b) response strength is 
greater the longer the exposure initially imposed on the animal— 
that is, in the start compartment, (c) conversely, response strength 
is weaker the longer the animal’s required exposure to the novel 
surround or goal that it explores, (d) response strength is greater 
the larger the magnitude of brightness-change reinforcement con- 
tingent upon the response (for example, running from black to 
white as opposed to gray), and (e) response strength is relatively 
independent of the conditions of stimulus exposure and brightness 
change imposed upon the animal earlier in its training, a fact that 
argues strongly for the motivational or “energizing” nature of these 
variables. Collectively, the findings demonstrate that the exposure 
and change variables can affect performances in a manner compar- 
able to conditions of appetitive motivation and reinforcement. As 
such, these data and also those from the parametric studies, pre- 
viously reviewed, offer strong support for the operation, within the 
context of exploration, of both drive and incentive-motivational 
factors. 

As supporting as the above data may be, it must be acknowledged 
that they are restricted to the particular behaviors, animals, and 
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types of stimulation studied, and thus strongly suggestive but cer- 
tainly not conclusive in any final sense. For this reason, additional 
studies of both the exposure and change variables will be required. 
Indeed, it would seem incumbent upon the exploratory-behavior 
theorist to provide the same intensive investigation of these drive 
and incentive variables as has been (and still continues to be) the 
case for the theorist interested in appetitive behaviors. Moreover, 
to complete the analogy drawn between appetitive and exploratory 
motivation, systematic studies of the effects of such relevant vari- 
ables as the delay and/or schedule of stimulus-change reinforce- 
ment must also be undertaken, Finally, assessment must be made 
of the implications of the formulation for other, if not broader, issues 
and factors relating to exploration. In the remainder of this chapter, 
we shall touch upon a few of these related concerns. 


RELATED Facrors AND RELEVANT Issuers 


As noted previously, early investigators of exploration (for ex- 
ample, Montgomery [4]; Harlow, 1958b ) simply postulated another 
drive in their attempt to account for the variability of this behavior. 
Thus their approach was to add one more to our list of so-called 
primary drives. With the present formulation, it is the intent of 
the author to imply quite th 


primary drives but rather primary sources of driv. 


terpretation would 


ecause of the extended integration 
of the number and kinds of empirical relationshi 


for example, those pertaining to appetitive, esca 
activities. Nevertheless, the meani 
and the relationships that it pos 
empirical confirmation. 


pe, and exploratory 
ngfulness of this interpretation 
its are Open to and must rest upon 


The Effect of Irrelevant Drive Sources 


to the stimuli currently impinging up 
our discussion above that the concur 
and hunger- or thirst-producing co 
going or dominant response patte 


on the organism, it follows from 
rent operation of both boredom 
ditions should energize an on- 
™ even more so than when any 
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of these conditions is operative alone. This summation effect rests 
upon the provision, however, that the particular response tendencies 
that may be associated with either the external or characteristically 
different, internal stimuli relating to the different drive sources are 
not incompatible or antagonistic. When these response tendencies 
are incompatible, as, for example, when a hungry animal must 
choose between exploring some unfamiliar surround and eating the 
food located therein, the response competition should lead to an 
interference rather than a facilitation of exploration. This effect 
seems evident in the results of a study by Zimbardo and Montgomery 
(1957). Hungry rats and thirsty rats for which food and water were 
available in the compartments of a checkerboard maze showed less 
exploration than similarly motivated rats for which food and water 
were not available. Furthermore, with increasing hours of food or 
water deprivation, the time spent exploring by the rats that could 
eat or drink was progressively shorter. Similar results have also 
been reported by Chance and Mead (1955). 

When the possible competing responses relating to the conditions 
of hunger and thirst are precluded, however, presumably by omis- 
sion of the appropriate goal objects—food and water—exploration 
may then be facilitated. This effect was initially observed in the 
early study by Dashiell [1]. Nonetheless, in recent investigations 
where both food and water have been omitted, the particular effect 
of hunger and thirst would seem to be of considerable doubt. For 
example, Montgomery (1953c) found that food or water depriva- 
tion reduced the exploration of female rats in an enclosed Y maze, 
and Zimbardo and Montgomery (1957) obtained the same effect 
for both male and female rats in an enclosed checkerboard maze. 
On the other hand, Glickman and Jensen (1961) obtained some 
evidence of a facilitating effect of hunger and thirst on the Y-maze 
exploration of male rats; and, with an elevated, rectangular maze, 
Thompson (1953) found that food deprivation increased the ex- 
ploration of male rats but not that of female rats. 

The discrepant findings reported in these investigations would 
seem primarily due to the particular measure of exploration that was 
employed, namely the number of maze units traversed by the ani- 
mal in a given period of time. As a sensitive or even valid indicator 
of the strength of exploration, this measure is severely wanting, and 
for two reasons: first, it is entirely uncertain that the animal travers- 
ing a greater number of maze units is exploring more than another 
animal stopping at each unit, perhaps, to investigate it thoroughly; 
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secondly, it is indeterminant whether the effect of the variables 
studied (hunger and thirst) are comparable for all of the com- 
ponents of the gross activity measured. In this latter regard, the 
results of a study by deLorge and Bolles (1961) are quite informa- 
tive. Separating the several components of behavior in an “open 
field,” these investigators found that investigatory and “window 
peeking” responses increased with food deprivation, whereas other 
components of open field behavior, such as locomotion, grooming, 
and cringing, were either unaffected or decreased with food dep- 
rivation. Moreover, these effects were found to be generally greater 
the longer the period of food deprivation. 

Aside from the particular measure of exploration used, there is 
another factor that has contributed to the equivocal nature of the 
findings. In order to determine whether hunger- and thirst-produc- 
ing conditions will additionally energize exploratory responses, it is 
incumbent upon the investigator to insure that exploration and not 
some other behavior, such as grooming or exercising, is the dominant 
response pattern. As Brown (1961) has cogently argued, “an in- 
crease in D [drive] does not activate or multiply approach tenden- 
cies alone, and reactions of exploring and manipulating would not 
be facilitated by intensified D unless these responses were, for other 
reasons, the dominant members of the response hierarchy.” 3 Un- 
fortunately, many investigators have failed to employ or even con- 


sider the experimental operations and stimulus factors that may be 
required to promote exploration. 


According to the proposed drive-incentive formul 
of both the instrumental and consummatory components of explora- 
tion may be accomplished in either of two ways: (a) by providing 
the animal with sufficient exposure to a relatively homogeneous 
surround prior to its receipt of unfamiliar objects or its introduction 
to an unfamiliar area (that is, by heightening its boredom or satia- 
tion), and/or (b) by providing sufficient stimulus change (that is, 
sufficiently different or complex stimuli to and for which the animal 
may respond). This second factor seems to underlie, at least in 


part, the positive results of Thompson’s study (1953). With an 
elevated maze and thus a more heterogeneous environment as pro- 


vided by extramaze stimuli, Thompson’s food-deprived animals 
generally showed more exploration than the nondeprived animals. 
In this regard, it is particularly noteworthy that Adlerstein and 


3J. S. Brown, The Motivation of Behavior (New York: McGraw-Hill Book 
Company, 1961), 336. 


ation, facilitation 
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Fehrer (1955) obtained comparable results for rats tested in an 
irregular maze that was structured so as to provide varied, extra- 
maze stimulation. 

With the above two studies, the animals were placed directly 
into an “unfamiliar” situation, rather than first being exposed to 
the situation and then being permitted either to investigate stimulus 
objects subsequently introduced or to leave the exposed (familiar ) 
surround in order to explore a different area. This latter type of 
arrangement, which relates more directly to the boredom construct 
outlined above and, thus, the other of the two conditions suggested 
as necessary for the demonstration of positive findings, has been 
employed in several studies. Fehrer (1956), for example, kept hun- 
gry and food-satiated rats in one compartment of an apparatus for 
24 hours before permitting them to leave this area to explore an 
adjacent novel area. Other hungry and food-satiated rats were 
placed directly into the apparatus without having had the oppor- 
tunity to experience the “familiar” area. No difference in the amount 
of exploration, as reflected by several measures, was found between 
the latter two groups, but with the groups permitted to leave the 
familiar situation, the food-deprived animals showed significantly 
more exploration; they explored the unfamiliar area sooner, more 
often, and for a longer period of time. As will be recalled, Zimbardo 
and Miller [11] obtained comparable results when they placed 
hungry and food-satiated rats into one compartment of a shuttle 
box and then gave them the opportunity to enter the other com- 
partment either immediately or after a two-minute delay. The 
results of a recent investigation by Richards and Leslie (1962) are 
also relevant in this context. These investigators found that when 
rats in a T maze were permitted to choose between novel and 
famijliar tactile stimuli (familiar through previous exposures ), rats 
of both sexes that were hungry or thirsty chose the novel stimulus 
alternative significantly more often than others that had been 
maintained on an ad libitum schedule of food and water. 

Evidence for the facilitating effect of irrelevant sources of drive 
on exploratory behaviors also derives from investigations of rats 
responding for weak light-onset. Although Hurvitz and De (1958) 
report a failure to find an increment in performance resulting from 
the addition of hunger, studies by Forgays and Levin (1958) with 
food-deprived and food-satiated rats and by Clayton (1958) with 
water-deprived and water-satiated rats have shown significantly 
more bar pressing by the deprived animals. Moreover, Davis (1958) 
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reports that the frequency of response for weak light-onset is posi- 
tively related to the length of food deprivation (0, 2, and 23% hours) 
imposed upon rats. In a different context, Miles (1962) obtained 
the same effect for cats permitted to manipulate various hanging 
objects. 

Collectively, the findings of this class of studies demonstrate that 
an irrelevant source of drive can additionally energize both the 
instrumental and consummatory components of exploration, And in 
accord with the proposed formulation, this summation effect be- 
comes evident when complex or heterogeneous test environments 
are employed, and/or when the animals are initially exposed to a 
relatively homogeneous surround and are then permitted to investi- 


gate unfamiliar objects or to leave the familiar surround and ex- 
plore an unfamiliar area. 


The Temporal Course of Exploration 


In contrast to the seemingly discrepant findings on the effect of 
irrelevant drive sources, one of the more reliable findings from 
studies on exploration is that, within a single test session entailing 
extended exposure to the unfamiliar stimuli present, animals show 
a marked decline over time in their investigation of these stimuli 
(Adlerstein and Fehrer, 1955; Berlyne, 1955; Glanzer, 1961; Mont- 
gomery, 195la, 1952b, [4]; Thompson, 1953; Thompson and 
Solomon, 1954; Welker, 1956b, c). This intrasession decline in ex- 
ploration is also evident with repeated test sessions (for example, 
Berlyne, 1950, 1955; Glanzer, 1961). 

Theoretically, 


trial or test session is not surprising, Comparable to the animal that 


tinued exposure to the unfamiliar stimuli, th 
to these stimuli such that they become less “ 
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In contrast to the temporal course of exploration within a trial or 
test session, a decrement in the amount of exploration or response 
to change over trials—that is, from one trial to the next—is not 
necessarily to be expected. The satiation accruing to the unfamiliar 
stimuli in one trial may dissipate partially or even completely dur- 
ing the interval between that trial and the next, for example, through 
the animal’s extraneous activity with other, presumably different 
stimuli, Hence, amount of exploration from one trial to the next 
should be influenced by the length of the intertrial interval: with 
long intervals, the satiation accruing in any one session may dissi- 
pate completely, with the result that amount of exploration over 
sessions remains relatively constant; with short intervals, on the 
other hand, some residual satiation may be present on a subsequent 
trial to produce a decrement in exploration. Accordingly, studies 
that have employed short intervals, for example, 10 minutes, show 
a large decrement in exploration over sessions (Berlyne, 1950, 1955, 
and Berlyne and Slater, 1957, for example), whereas, those employ- 
ing intervals as long as 24 hours or more show a marked constancy 
in amount of exploration over sessions (for example, Berlyne, 1955; 
Butler and Alexander, 1955; Montgomery, 1952b, [4]) or, at most, 
a relatively slight and gradual decline (for example, Berlyne and 
Slater, 1957; Zimbardo and Montgomery, 1957). This latter dec- 
remental effect suggests that the temporal course of exploration 
over trials is not solely a function of the intertrial interval. ; 

Other factors suggested by the drive-incentive formulation as 
significant determinants of the temporal course of exploration in- 
clude (a) the length of the test trial or session itself, and (b) the 
degree of complexity of the test situation. With very long test 
sessions, permitting extensive satiation to the stimuli present, an 
intertrial interval of 24 hours or more may be insufficient for com- 
plete dissipation of the satiation accrued. This being the case, re- 
sidual effects on subsequent trials would produce a decrement in 
amount of exploration. Further, this decrement would be pronounced 
with extensive exposure to a relatively simple or homogeneous test 
situation, but diminished with a complex or heterogeneous arrange- 
ment, The animal’s commerce with the variety of stimulus elements 
comprising the complex situation should facilitate a more gradual ac- 
cumulation of satiation to the situation or pattern as a whole, because 
exposure to one element of the complex pattern permits nonexposure 
and therefore dissipation of the satiation accrued to another, pre- 
viously experienced element. Thus for experimental arrangements 
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involving the same intra- and intertrial intervals, but different de- 
grees of complexity, intra- and intertrial decrements in exploration 
should be more gradual or perhaps nonexistent the greater the 
complexity of the test situation. It is also conceivable that experi- 
mental arrangements involving short, daily exposures to large and/ 
or complex stimulus situations will produce a gradual increment in 
the amount of exploration over sessions. The animal may satiate to 
an initial portion or area of the complex test environment and then, 
because of some residual satiation on a subsequent trial, explore this 
area only briefly prior to moving on to additional areas. Although 
noted quite infrequently, this incremental effect has been obtained 


in studies employing conditions similar to those described above 
(Glanzer, 1961; Montgomery, 1952b). 


The Efficacy of Exploratory Rewards 


In that the above findings generally show that exploration under- 
goes a marked decrement with continued exposure to an unfamiliar 
stimulus pattern, and then recovers during a period of nonexposure 
to the pattern, these effects may be described quite loosely as the 
“extinction” and “spontaneous recovery” of exploration. As such, 
the above findings have been interpreted by some investigators as 
demonstrating that the reinforcement or reward value of a change 
in stimulation will subsequently pall. And on the basis of this in- 
terpretation, it is further argued that the use of incentive-motiva- 


tional constructs to explain both appetitive and exploratory behaviors 
is quite incongruous; 


. although expectancy-produced drive [incentive motivation based 


on anticipatory goal responses to food] becomes stronger as a function of 
the number of encounters with 


, goal responses are extinguished 
when the rewarding object is omitted, while curiosity is extinguished 
when the rewarding object is kept in the situation.4 

At least two factors contribute to th 
first relates to the looseness with which the curiosity concept has 
been employed in previous accounts of exploration, resulting for 
example in the simultaneous ascription of both drive and reinforcing 

4 Ibid., 335 f. 


e apparent incongruity. The 
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properties to novel stimuli. The inadequacies of this position—in 
particular, the paradoxes that it generates—were described earlier 
and need not be discussed further. The second factor relates to the 
failure of some writers to distinguish between experimental arrange- 
ments involving the consummatory or goal response to stimulus 
change—that is, the exploratory response elicited by the novel 
stimuli—and those situations involving response for change, be- 
haviors such as bar pressing, running, and so on, which are instru- 
mental to stimulus-change reinforcement. 

The distinction between the instrumental response for change and 
the consummatory response to that change is essential for the follow- 
ing reasons, First, it is the instrumental response for which the 
anticipatory goal-response mechanism works; indeed, it would ap- 
pear unlikely that the characteristic stimulation (sg) of the anticipa- 
tory goal response (rg) serves to intensify the goal response itself! 
Secondly, it is the instrumental response that is reinforced by the 
occurrence of the novel stimulus serving as the UCS; the goal or 
exploratory response, on the other hand, is elicited by the UGS. 
Hence, any assessment of both the efficacy of exploratory rewards 
and the adequacy of explanations based upon anticipatory-response 
mechanisms must have reference to the instrumental component of 
exploration and not to its consummatory component. Most appro- 
priate in this context, then, are the findings of the parametric studies 
and the program of research considered earlier, and also that class 
of studies (reviewed in Chapter II) that demonstrated that animals 
would learn to respond for a change in stimulation. It will be re- 
called that “the reinforcing nature of a mild or moderate change 
in stimulation is clearly indicated in the above class of studies: 
particular responses are progressively increased in strength over 
successive trials or days of trials, maintained with considerable 
strength, and then gradually extinguished with removal of the stim- 
ulus consequence or change employed as the reinforcer.” (Chapter 
II, page 37.) 

By the very nature of the novel stimulus that serves as the rein- 
forcer, however, both the magnitude and temporal extent of the 
change in stimulation that it provides should be critically depend- 
ent upon the particular distribution of training trials used to study 
its reinforcing effect. As with the consummatory response to change, 
then, a decrement in the strength of the jnstrumental response may 
also be observed (for example, Girdner, 1953; Kling, Horowitz, and 
Delhagen, 1956) when a relatively short temporal distribution of 
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trials or sessions (or responses within a session in the case of the 
free-responding—for example, bar-press—situation) is employed. 
With this schedule of training, repeated massed exposures to the 
novel stimulus serving as the reinforcer should deplete its “novelty,” 
thereby reducing the extent of the change in stimulation that it 
affords, and consequently, the magnitude of stimulus-change rein- 
forcement contingent upon the instrumental response. This effect 
may even be sufficiently pronounced so as to preclude the learning 
of instrumental behaviors. Thus in the Myers and Miller [7] study, 
cited earlier, rats learned to press a bar to gain entry into a black 
compartment from a white one, or vice versa, but only when the 
trials were widely distributed; animals with highly massed trials 
exhibited little if any learning. These same results have also been 
obtained in a recent study by Forgays and Levin (1961). 

Aside from the effects of a massed training schedule, the data 
leave little doubt that the strength of the instrumental response for 
stimulus change increases over daily trials or sessions, whereas 
the strength of the exploratory or consummatory response to the 
change remains relatively constant. Hence, with reference to the 
instrumental component of exploration, there can similarly be little 
doubt regarding the efficacy of exploratory rewards or of the ap- 
propriateness of explanations based on anticipatory-response mech- 
anisms, The data are in agreement with the view that curiosity, 
redefined as an incentive-motivational construct, may become 
stronger as a function of the animal's encounters with the goal ob- 
ject, that repeated reinforced trials may strengthen the anticipatory 
responding that underlies this incentive-motivational effect, and 
conversely, that the anticipatory responding may be extinguished 
when the reinforcement is omitted, 


Curiosity and Common Sense 

As is emphasized with the above, the Proposed formulation treats 
curiosity as a learned, anticipatory reaction to the changes in stimu- 
lation contingent upon some instrumental act. Accordingly, curiosity 
is not present when the animal initially encounters a novel or un- 
familiar surround, but only on subsequent occasions or trials, and 
only as a result of the animal learning to anticipate the unfamiliar 
stimuli. This conceptualization of Curiosity contrasts strikingly with 
that provided by “common sense” and, as such, requires some 
comment. 

The “common sense” point of view, as voiced by the early curiosity 
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theorists, suggests that curiosity is present with the animal’s initial 
receipt of the novel stimuli; curiosity is not a learned reaction but 
rather an innate one elicited by these stimuli. Casual observations 
of a tamed animal placed for the first time in a completely novel 
surround would certainly seem to support such a contention. The 
animal readly explores the novel stimuli, apparently without the 
aid of satiation or boredom and certainly without the motivation 
stemming from any learned anticipation of these stimuli. Hence, to 
the extent that exploration-eliciting stimuli are, in fact, novel—that 
is, on an absolute basis—explanations of “curiosity” behavior that 
are based on the learning of object or condition-specific anticipatory 
reactions would seem patently inappropriate. Nevertheless, the type 
of observation noted is not antagonistic to the present formulation. 

First, it must be recognized that the animal’s test environment 
can only be novel or unfamiliar to the extent that it differs (affords 
a change) from the stimuli to which the animal has been exposed 
prior to testing. Thus, aside from the fact that animals are typically 
maintained in a somewhat sensorily depleted laboratory setting, 
exposure to any stimulus condition prior to the animal's introduction 
to novel stimuli should serve to promote satiation and thereby to 
energize the variety of exploratory reactions that may be elicited 
by (directed to) the change in stimulation afforded by these novel 
stimuli. Secondly, and just as important, is the possibility that the 
animal’s initial approach and investigation of novel or unfamiliar 
stimuli may reflect, as Brown (1953a) has argued, not any innate 
reaction of curiosity or wonderment but instead, and quite simply, 
generalized response tendencies that were acquired on past occa- 
sions to other, similar stimuli. This interpretation may be elaborated 
upon within the proposed formulation. 

Although reference is made to the animal’s acquisition of an ob- 


ject or condition-specific anticipatory reaction, it should not be 
overlooked that the animal’s previous history may be replete with 
ditioned, anticipatory reactions 


an immense variety of previously con 

of orientation, approach, and/or investigation, one for each novel 
or unfamiliar event or object experienced. Indeed, it may well be 
that, as a result of the animal’s previous encounters with an im- 
mense variety of unfamiliar and changing stimuli (literally, one at 
every turn), an anticipatory investigatory reaction becomes con- 
ditioned generally, comparable to a learning-to-learn phenomenon. 
The basis for this conditioning effect would be the ever-present 
internal stimuli associated with the animal’s satiation (exposure) to 
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one stimulus condition prior to its receipt of a different—that is, 
novel or unfamiliar—one. Thus through the action of a generally 
conditioned rg or, as Brown (1953a) suggests, through the action 
of generalized anticipatory reactions (quite possibly conditioned 
to the cues of satiation, also), the animal in its initial encounter with 
a new and completely different surround may be replete with gen- 
eralized incentive motivation. And this generalized source of moti- 
vation could well be sufficient for the energizing of approach and 
investigatory reactions and even, in fact, that vague sense of won- 


derment or anticipation which, by common sense, comes under the 
label “curiosity.” 


CHAPTER 


Some Recent Developments 


and Future Considerations 


THE ADEQUACY OF THE CURIOSITY OR 


incentive-motivational construct proposed in the previous chapter, 
the boredom or drive-motivational concept, as originally espoused 
by Myers and Miller [7]* would seem to have gained a firm 
empirical basis, one that attests to its adequacy both as a 
meaningful and fruitful concept (see Chapter I). One would think 
that the evidence in support of this exploratory-drive concept would 
be sufficient, then, to promote at least its consideration, if not ac- 
ceptance, Actually, just the opposite has been the case. Not only did 
the concept come under sharp criticism in the early 1950's, when it 
was formally introduced into the mainstream of psychological the- 
orizing, but even in recent years its treatment has been no less than 


severe. Thus Koch (1961) tells us: 


ASIDE FROM 


. one can only wince at the current tendency to talk about such things 
as “curiosity drives,” “exploratory drives,” “sensory drives,” “perceptual 
drives,” etc. as if the “activities” which are held to “satisfy” each of the 
“drives” (if indeed they are distinct) were just so much undifferentiated 


neutral pap that came by the yard.? 


The remarks of others would seem to be a bit more constructive. 

For example, White (1959) questions the adequacy of the explora- 

tory-drive concept specifically on the following grounds: first, on 
1 Bracketed numbers refer to readings in Part Two. 


25, Koch, “Psychological Science Versus the Science-Humanism Antinomy,” 
American Psychologist, 1961, 16, 633. 
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the basis of its bearing no discernable relationship to a tissue need; 
secondly, on the absence of any consummatory response or “climax” 
to the behavior that the exploratory drive presumably motivates; 
and thirdly, on the difficulty of relating the reinforcement involved 
with exploration to the reduction of a need. 

Although White’s (1959) criticisms seem quite cogent, their close 
examination reveals that they are no more constructive than Koch’s 
(1961). Considering them in order, we may recall from Chapter I, 
and thus note first, that one of the theoretical refinements offered 
by the contemporary drive theorists in the forties and fifties (for 
example, Spence, 1944, 1952) was their explicit treatment of drive 
as a theoretical construct that had no substantive reality (for 
example, tissue basis) but that was convenient for purposes of inte- 
grating the facts within the relatively circumscribed area of investi- 
gation designated by the conditions or operations defining the 
construct. Secondly, we may reiterate a point argued in both Chapters 
II and III: the functional relationships existing between a novel 
stimulus and the exploratory response that it elicits appear analogous 
in every respect to those between the UCS of food and the UCR or 
consummatory response of eating; hence, in the context of explora- 
tion, the consummatory behavior (or “climax”) is one and/or all 
of the components of seeing, looking, and orienting; it is the ex- 
ploration or response to change itself. And finally, as noted in Chap- 
ter III, the reinforcement relating to this behavior, at least its 
instrumental component, is the change in stimulation afforded by 
the novel stimulus serving as a UCS; correspondingly, the drive 
(rather than need) reduction underlying this reinforcement effect 
is the reduction of the animal’s satiation to those stimuli that it 
experiences prior to its receipt of the novel stimulus. 

One may certainly question why the above types of criticisms 
have been offered, when the data appear so supporting of the ex- 
ploratory-drive concept. The answer appears to lie with either the 
unacknowledged or unrecognized fact that these criticisms are not 
general ones; they relate not to the satiation or boredom conceptuali- 
zation of the exploratory drive but rather to the early curiosity con- 
ceptualization. As will be recalled, the inadequacies of this latter 
position, in which both drive-eliciting and reinforcing properties 
are ascribed to novel stimuli, are reflected in two paradoxes: (a) the 
exploratory drive is not produced until after the animal performs 
the instrumental response the drive is supposed to be motivating, and 
(b) instrumental responses that are reinforced by novel stimuli lead 
to an increase in drive rather than to its reduction or termination. 
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This second paradox provides, in part, the basis for the second and 
third points of White's (1959) criticism and, more important, the 
foundation for a theoretical camp that has only recently emerged, 
one that we shall consider directly. However, at this point, we 
should pause long enough to consider a relatively simple, but 
nevertheless important, aspect of psychological theorizing. 
Obviously, a concept can only be assessed through its operational 
or defining condition, However, when more than one of these de- 
fining conditions exists, the paradoxes observed may relate not to 
the inadequacy of the concept and its ascribed functions, but in- 
stead to the inadequacy of one of the defining conditions suggested 
for the concept; and so it seems to have been with the concept of 
an exploratory drive, at least as it was defined by the early curiosity 
theorists. Apparently many investigators still fail to recognize the 
significance of this distinction, for even today it is generally held 
that the second paradox cited above actually reflects the inadequacy 
of the drive concept and, correspondingly, that of the drive-reduc- 
tion hypothesis. It is no wonder then that, when this seemingly 
inevitable conclusion first presented itself, many investigators were 
led to seek out a theoretical innovation, one which would relieve 
the waning drive concept of all its burdens and thereby replace it. 


Tuer Concert oF OPTIMAL STIMULATION 
OR AROUSAL 

The makings for the n 
tion or arousal appeared in the mi 
primarily the behavioral data that 
the paradox that much learning appears 
of increasing drive, Leuba [12] argued as follows: 
uld not seem to be a general or the only 


aspect of a more general prin- 
ne of optimal stimulation: the 


ew conceptualization of optimal stimula- 
d-fifties and on two fronts. Citing 
we have reviewed, in particular 
to occur under conditions 


Tension [drive] reduction wo 
principle of learning. It may be only one 
ciple, a principle which might be called o 
organism tends to learn those reactions which will produce an optimal 
level of total stimulation . . . reactions which, when overall stimulation 
is low, are accompanied by increasing stimulation; and when overall 
stimulation is high, those which are accompanied by decreasing stimula- 


tion.8 
At the same time, Hebb [13] argued in a similar vein and for 
similar reasons, but primarily in reference to physiological data 


3 C. Leuba, “Toward Some Integration of Learning Theories: The Concept 
of Optimal Stimulation,” Psychological Reports, 1955, 1, 28f. 
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(for example, Lindsley, 1951; Moruzzi and Magoun, 1949) that 
drew attention to the diffuse projection system of the brain stem 
as an “arousal” or “activating” system by which all sensory excita- 
tions could reach the cortex. To paraphrase Hebb, when sensory 
input or bombardment of the arousal system is low, and therefore 
when arousal itself is low, responses that produce increased stimula- 
tion and hence greater arousal will be repeated (presumably rein- 
forced and strengthened). On the other hand, very high or intense 
sensory bombardment, producing high arousal, should serve to 
repel the behavior that leads to this intense stimulation, for example, 
by facilitating conflicting or alternative responses. “Thus there will 
be an optimal level of arousal for effective behavior. . . .” 4 

The view expressed by both Leuba [12] and Hebb [13] formed 
the basis, then, for a new kind of “drive” concept: both decreases 
and increases in drive (arousal) could be reinforcing (or motivat- 
ing, for that matter) depending upon the organism’s momentary 
level of total stimulation and arousal. Hence, with this new con- 
ceptualization, which is reminiscent of Cannon's (1932) early 
doctrine of homeostasis, the “paradoxical” finding that animals 
would explore or seek out increased stimulation no longer posed 
a problem. The attractiveness of such a position was not to go 
unnoticed, and soon it formed the basis for independent but similar 
conceptual frameworks that were advanced by both Berlyne (1960, 
1963) and Fiske and Maddi (1961). We shall treat each of these 
recent formulations, starting first with Fiske and Maddi’s (1961), 
primarily because of the more formalized nature of their the- 
ory. 

The substance of Fiske and Maddi’s theory is contained in the 
form of eight propositions that may be paraphrased and summarized 
as follows: 

Propositions 1-3: The organism’s momentary level of activation 
(or arousal), A.L., is directly related to the combined impact—that 
is, intensity, novelty, and meaningfulness—of all the stimuli, both 
external and internal, impinging upon the organism at a given mo- 
ment, (A.L. is presumed to relate to the excitatory state of the dif- 
fuse projection system of the brain stem referred to by Hebb [13]. 
The “novelty” of a stimulus is the extent to which the stimulus 
provides variation from the organism’s previous stimulation; its 
“meaningfulness” has reference to the organism’s perception of its 


4D. O. Hebb, “Drives and the C.N.S. 
Psychological Review, 1955, 62, 250. 


(Conceptual Nervous System) 
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significance, as, for example, reading the word fire in a newspaper 
as opposed to hearing it shouted in a crowded theater.) 

Propositions 4-5: In any given task, there is an optimal A.L. for 
effective performance; the organism will behave so as to maintain 
this optimal A.L. (Accordingly, “effective” performance is an in- 
verted U-shaped function of A.L. or, from propositions 1-3, total 
stimulus impact. When total stimulus impact is “too” low, the 
organism will attempt to increase stimulus impact; and vice versa.) 

Propositions 6-7: There is a normal A.L. that varies with the 
organism’s sleep-wakefulness cycle; in the absence of specific tasks, 
the organism behaves so as to maintain the A.L. characteristic of 
the particular time of the sleep-wakefulness cycle. (A.L. is pre- 
sumed to be lowest during sleep, higher during the beginning and 
end of wakefulness, and highest during maximal or complete wake- 
fulness. ) 

Proposition 8: When A.L. differs markedly from the normal level 
or the optimal level for a specific task, the organism will experience 


negative affect; positive affect will be experienced when A.L. is 
modified so that it approaches the normal or optimal level. (Positive 
affect is viewed as being comparable to reinforcement; negative 


affect, as comparable to heightened motivation. ) 
It should be evident that the Fiske and Maddi (1961) theory is 


quite comprehensive; indeed, it has reference to all of behavior and 
the extent to which such behavior will be “effective.” Because our 
concern, however, is primarily with curiosity and exploration, we 
shall limit an evaluation of the theory to these behaviors, and in so 
doing, we may consider the level to which the concept of optimal 
stimulation or arousal can rise (or fall) as an explanatory construct. 


The Rise and Fall of Arousal—As a Concept 

The Fiske and Maddi (1961) formulation would seem to fare 
quite well, accounting for variations in both the instrumental and 
consummatory components of exploration. For example, exploration 
or response to change may be deduced from propositions 1-3, 6-7: 
under conditions of low arousal (minimal stimulus variation, as is 
presumably the case with exploration ), the organism engages in 
behaviors, such as orienting, investigating, and/or manipulating, 
which increase total stimulus impact and thereby sustain its normal 
A.L. Confronted, on the other hand, with conditions of “extreme” 
novelty and thus high arousal, as presumably was the case for 
Hebb’s [13] chimpanzees viewing a stranger Or ihe model of a 
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human head, the animal engages in impact-decreasing behaviors— 
for example, withdrawal or flight—aimed at lowering its A.L. With 
the addition of proposition 8, the reinforcement or strengthening of 
behaviors—bar-press, running, and so on-which are instrumental 
to a moderate change in stimulation may also be explained. These 
behaviors, also occuring presumably under low arousal, provide for 
the organism’s experiencing of variation (novelty), heightened 
arousal, and hence positive affect. Furthermore, the strength of 
these instrumental responses should be greater with longer exposures 
to relatively homogeneous surrounds and with larger magnitudes of 
stimulus variation or novelty contingent upon them, because greater 
positive affect is afforded, either directly or indirectly, by both of 
these conditions. With an explanation of these general phenomena 
of exploration at hand, let us now consider certain, specific aspects 
of the behavior, 

As noted in the previous chapter, exploration undergoes a marked 
decrement when the animal is confronted for an extended duration 
with a novel stimulus or surround, Presumably, this is due to a 
diminution in the novelty or unfamiliarity of the stimulus and, cor- 
respondingly, to its inability to maintain increased impact and, hence, 
heightened arousal. With its initial presentation, however, the then 
novel stimulus did afford increased impact and heightened arousal 
and also positive affect. Thus it would seem to follow from the Fiske 
and Maddi proposition set that, with lengthy periods of nonexposure 
to the “novel” stimulus—for example, intertrial intervals of 24 hours 
—repeated exposures to this stimulus should provide. repeated oc- 
casions of positive affect (reinforcement), and thereby lead to an 
increase in the amount of exploration obtained over test sessions. 
Contrary to this expectation, the data show that exploration or re- 
sponse to change remains relatively constant over repeated test 
sessions or even tends to decrease; comparatively few studies have 


ever reported an increase in the amount of exploration over test 
sessions. 


The same paradox presents itself eve 
context of alternation behavior. After the animal's initial exploration, 
for example, of the black arm of a T maze, it selects the unfamiliar 
—for example, white—arm presumably to sustain its normal level 
of impact and arousal. But the animal’s initia] exploration—that is, 
of the then novel black arm—should afford positive affect and there- 
by permit a strengthening of the tendency to investigate that arm, 
rather than the tendency to alternate. To make matters worse, sev- 


n more strikingly in the 
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eral alternation studies (for example, Fowler, Blond, and Dember, 
1959; Rothkopf and Zeaman, 1952; Zeaman and House, 1951) have 
employed food reinforcement on the first trial that, if anything, 
provides for greater positive affect, because food for the hungry 
animal enables it to sustain its normal level of impact and arousal. 
Nevertheless, these studies have shown that the alternation tendency 
persists and further that, up to a point and prior to the animal's 
choice of arms, repeated food-reinforced trials to the same arm of 
the T maze only heighten the alternation tendency! In fact, alterna- 
tion on the first few choice trials has only been counteracted com- 
pletely when the additional reinforcement, extrinsic to exploration, 
is in the form of shock reduction, and of a considerable magnitude 
(Fowler, Fowler, and Dember, 1959). These “positively affective” 
difficulties are not half so bad in view of other considerations. 
With all of the food-reinforcement studies noted above (as well 
as with other alternation studies and even some general exploratory 
studies), the animals performed under food deprivation, a condition 
of intense, interoceptive stimulation and, thus, high arousal. Never- 
theless, these animals, and even those performing under low in- 
tensities of shock in the Fowler, Fowler, and Dember (1959) study, 
continued to alternate, presumably because they were under low 
arousal. Now which is it? High arousal, low arousal, or some inter- 
mediate value? (In the latter case, which seems to be the logical 
deduction, the animal should be at or near an optimal level of 
arousal and thus quite content so long as it continues to explore 
familiar stimuli!) These same embarassments are also evident in 
the results of studies that have investigated the effects on explora- 
tion of irrelevant drive sources. Although, as noted previously, some 
of these studies obtained less exploration when the animals were 
hungry or thirsty, by and large, most of them have reported in- 
creased exploration, especially when heterogeneous test environ- 
ments are employed and/or when the animals are initially exposed 
to a homogeneous surround and are then permitted to explore un- 
familiar areas or objects. But these differences should pose no 
problem; the findings may easily be explained by the a posteriori 
assertion of the animal's level of arousal. If the animal explores more, 
arousal must have been “too” low (even under the intense intero- 
ceptive stimuli resulting from food or water deprivation); on the 
other hand, if the animal explores less, then arousal must have been 
“too” high. The deciding question, however, is, which will it be? 
Interestingly enough, within the confines of these specific cases, the 
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concept of optimal stimulation or arousal affords us the basis for 
explaining “everything” and predicting “nothing.” Such a predica- 
ment is strange, indeed—unless, of course, the converse of our first 
Proposition is true. 


Reprise 

The conceptual framework recently espoused by Berlyne (1960, 
1963) is quite similar to Fiske and Maddi’s (1961): both formula- 
tions describe the animal’s behavior as being directed to the main- 
tenance of an optimal or intermediate level of stimulus impact. 
Nevertheless, these formulations differ significantly with respect it 
their underlying assumptions and thus with respect to their predic- 
tive and explanatory utility. Whereas Fiske and Maddi propose that 
the animal behaves so as to maintain (through increments and dec- 
rements ) an intermediate or optimal level of arousal, arousal being 
directly related to stimulus impact, Berlyne suggests that the animal 
performs in order to reduce arousal, arousal being simply a U-shaped 
function of stimulus impact. In other words, for Berlyne, arousal is 
high not only under stimulus conditions that are very novel or 
unfamilar but also under those conditions in which the stimuli are 
very familiar or monotonous. The basis for the assumption of high 
arousal with the animal’s exposure to familiar or monotonous stimu- 
lation stems primarily from studies that show that for human 
subjects, a condition of sensory deprivation—that is, an extended 
period of minimal stimulus variation—occasions a rise in those 
physiological measures, for example, muscular, circulatory, and EEG 
activity, which are typically taken as indices of arousal. More im- 
portant, however, is the fact that this assumption and the additional 
one, that the animal behaves so as to reduce arousal, provide the 
makings of a formulation in which the concept of arousal is not only 
equated with that of drive but in its traditional sense. And to this 
end, Berlyne (1963) has argued rather extensively. 

Berlyne’s conceptualization fares considerably better than that 
espoused by Fiske and Maddi (1961), but not simply by reason of 
the fact that the arousal concept is equated with the drive concept; 
rather, the conceptualization fares better because it precludes the 
inconsistencies noted for the Fiske and Maddi formulation. For 
example, by positing exposure to constant and unvarying stimula- 
tion as a condition of high arousal (or drive), Berlyne’s interpreta- 
tion affords an unambiguous prediction as to the effect on 
exploration of irrelevant drive sources. Since these conditions, such 
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as food or water deprivation, are also productive of high arousal, 
their energizing or activating effect should summate with that of 
stimulus exposure (or stimulus-change deprivation) to produce 
the increased exploration obtained in those studies where the pos- 
sible competing responses relating to the irrelevant drive sources 
have been precluded. Even the perplexing alternation-food rein- 
forcement problem may be resolved with the assumption that both 
deprivation of stimulus change and of food are drive or arousal- 
producing conditions. Summating, the effects of these drive condi- 
tions should additionally energize the initially dominant alternation 
tendency, dominant because the novel stimuli of the unfamiliar arm 
are visible at the choice point and can elicit the exploratory response 
to them, whereas with the food reinforcement typically in a recessed 
cup at the end of the familiar arm and thus not visible, the animal 
must receive sufficient training to learn where to respond for the 
food. However, this additional training, entailing successive €x- 
posures to the familiar arm containing the food, will also serve to 
heighten the animal’s satiation to that arm, thereby temporarily 
protracting, if not increasing, the dominance of the alternation 
tendency (see Fowler, Blond, and Dember, 1959). 

The predictive and explanatory utility of designating stimulus 
exposure as a condition of high drive or ‘arousal would seem, then, 
not to be denied. Nevertheless, Berlyne finds himself not completely 
committed to this boredom-drive concept, primarily because “in 
experiments on investigatory behavior in animals, the stimuli con- 
sequent on an investigatory response often have some reward value 
even when there is no prior period of stimulus deprivation. 5 For 
this reason, and apparently his failure to recognize that the relevant 
variable underlying boredom or satiation may not be stimulus depri- 
vation but rather stimulus exposure (0r, conversely, stimulus-change 
deprivation), Berlyne suggests that exploratory performances may 
also be motivated by a curiosity drive. It is here that his formulation 
runs aground, for this conceptualization is essentially that which he 
espoused as one of the early curiosity theorists, and as such, it is 
subject to the limitations previously noted for the concept. Because 
these limitations had reference to the jnstrumental component of 
exploration, it is conceivable that the concept of a curiosity drive 
might be applicable to the consummatory component of exploration 


5D. E. Berlyne, “Motivational Problems Raised by Exploratory and Epistemic 
Behavior,” in S. Koch (ed.), Psychology: A Study of a Science, Vol. 5 (New 


York: McGraw-Hill Book Company, 1963), 305. Italics added. 
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—that is, the response to change. One could argue, then, as Berlyne 
has, that novel, unexpected, and/or perceptually ambiguous stimuli 
first raise and then reduce the drive, the two processes of drive 
induction and then reduction (reinforcement ) taking place in imme- 
diate succession. Unfortunately, there are two difficulties inherent 
in such a position: first, for the conceptualization to be mean- 
ingful and thus assessable, reference must be made to the two 
processes in contexts that are clearly separable and definable as 
such in terms of specific operations, but this would seem virtually 
impossible; secondly, by assigning drive-inducing properties to 
novel, unexpected, or ambiguous stimuli, there appears to be no 
clearly discernible basis for predicting exploration, because it 
logically follows that the animal may reduce its curiosity drive 
simply by turning away from these stimuli rather than by exploring 
them. In this context, it may also be noted that the concept of a 
curiosity drive becomes superfluous when one posits a boredom or 
satiation drive (at least one that is defined in terms of stimulus 
exposure rather than deprivation); the latter is logically applicable 
to every unfamiliar or unexpected stimulus complex because of the 
change in stimulation that the complex affords relative to the ani- 
mal’s previous stimulation. 

As a whole, Berlyne’s formulation (as well as Fiske and Maddi’s) 
would seem suspect for additional reasons. For example, one may 
question the truth of the assumption that stimulus novelty and stim- 
ulus intensity represent independent but compatible dimensions of 
stimulus impact. This assumption, together with that positing 
arousal as a U-shaped function of stimulus impact, commits Berlyne 
to the rather dubious hypothesis that an animal will be highly 
motivated when exposed to a stimulus condition that is neither too 


novel nor too familiar and yet of very low intensity, Aside from 
these criticisms and those noted above in regard to the concept of 


a curiosity drive, Berlyne’s formulation is instructive because of the 
convergence of theoretical ideas that it reflects, Initially proposed 
as a new and alternative conceptualization to the drive formulation, 
the concept of arousal turns out to be nothing more than that which 
it was supposed to replace. Indeed, with a view toward the theoreti- 
cal difficulties encountered by Fiske and Maddi’s conceptualization 
of arousal, and the resolution of these difficulties by Berlyne’s equat- 
ing of arousal with drive, we are left with the distinct impression 
that only through this old and worn concept of drive can our new 
one gain its salvation. 
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INFORMATION-THEORETIC CONCEPTS 

Together with the intensification and proliferation of research 
and theory on exploration in the early 1950's, there emerged another 
but entirely different kind of conceptual framework, that of informa- 
tion theory (see Miller and Frick, 1949). Until recently, the rele- 
vance of information theory to the study of exploration went 
unnoticed, perhaps because of its very nature, for contrary to other 
theories, this one did not provide a set of propositions by which 
explanations or predictions of behavior could be derived; instead, it 
provided techniques for quantifying the organization of events as 


perceived by the animal. Nevertheless, this new way of quantifying 


events could suggest a new way of conceptualizing their effect on 
se with exploration. 


behavior, and such was soon to be the ca 

The relationship between information theory and the stimulus 
events that affect curiosity and exploratory behaviors becomes 
evident when one considers the meaning of the term information. 
This term does not have reference to knowledge or understanding, 
or other commonly employed synonyms, but instead to a reduction 
of entropy or uncertainty in the organism (see Shannon and Weaver, 
1949), This special meaning of the term is not so perplexing when 
we consider that the organism gains absolutely no “information” 
if it is certain of the sequence of events that it will experience—for 
example, events that are redundant, repetitive, and completely 
organized (or as we might say in the context of exploration) 
unchanging and completely familiar. On the other hand, the organ- 
ism gains considerable information when it experiences a sequence 
of events of which it is uncertain—for example, events that are 
varying, disorganized, or random in nature and order, or (again, as 
we might say) changing and unfamiliar. In the context of informa- 
tion theory, then, when the animal explores a novel surround, or 
unfamiliar pattern or object, it reduces its uncertainty of the se- 
quence of stimulus events or elements that it experiences, and thus 
it gains information; and the more change or variation provided, 
the more information it gains. 

Following a lead by Attneave ( 
mation theory to visual perception, 
assess the effect of visual stimuli that 
relative uncertainty (for example, complexity) on human “percep- 
tual curiosity.” College students were placed in a darkened room 
and then were permitted to make as many key-pressing responses 


1954) on the relevance of infor- 
Berlyne [14] proceeded to 
differed in their degree of 
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as desired for very brief exposures to different kinds of visual pat- 
terns ranging from simple geometric to animate forms. This first 
study of information-theoretic variables showed that frequency of 
responses for the visual patterns increased progressively over the 
course of training (indicative of a learning effect) and varied 
directly with the degree of complexity, asymmetry, and irregularity 
of the patterns, or in other words, with the amount of information 
provided. Hence, the application of information theory to the study 
of human exploration prompted the discovery and isolation of a 
class of variables that were found to be both potent eliciters of 
visual exploration and reinforcers of such instrumental behaviors 
as the key-press response made by college students. 


Information Deprivation and Information Reinforcement 

Recently, Jones and his associates (Jones, 1961; Jones, Wilkin- 
son, and Braden, 1961) initiated a program of research that Was 
designed to assess the relationship between information-theoretic 
concepts and the motivational propositions of S-R reinforcement 
theory. Reasoning that the motivational determinants of information- 
acquiring or exploratory behaviors might well be comparable to 
those underlying appetitive or food-seeking behaviors, for example, 
Jones et al. (1961) subjected college students to different lengths 
of information deprivation, a condition of maximum certainty of 
stimulation. To produce this unvarying stimulus condition, the 
subjects (in two experiments) were isolated for 10 or 12 hours in a 
lightproof chamber with audition greatly restricted and then, after 
0, 1, or 5 hours, they were permitted to press a button that caused a 
patterned series of faint light flashes, varying in the randomness of 
their order (that is, in amount of information), to appear on the 
ceiling. The results of these two experiments showed that frequency 
of response for the light flashes was positively related both to the 
length of the subject’s period of information deprivation and to the 
amount of its information reinforcement. Hence, these findings 
indicated that information served as an incentive or goal condition 
and information deprivation as the drive condition underlying 
behaviors directed to this type of incentive, 

To assess further the interpretation that information deprivation 
functioned as a drive variable, the energizing effect of which should 
summate with that provided by an irrelevant drive source, Jones 
(1961) then subjected three groups of college students to informa- 
tion deprivation, but with one group also being deprived of food 
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and another receiving occasional shocks throughout the experi- 
mental session. In accord with the summation hypothesis, both the 
food-deprived and shocked subjects showed higher proportions of 
response for information reinforcement during the first half of the 
experimental session. 

The findings of Jones’ research are significant for several reasons. 
First, they demonstrate that a drive-incentive formulation of curi- 
osity and exploratory behaviors may also develop from the relatively 
independent framework provided by information theory. Secondly, 
and together with Berlyne’s [14] findings, they highlight the neces- 
sity of treating exploratory or response-to-change phenomena within 
a broad framework, one inclusive not only of relatively simple 
changes (as provided by novel or unfamiliar stimuli) but also of 
the more complex kind relating to information-theoretic variables. 
And finally, through their bearing on curiosity and exploration in 
humans, they serve to illustrate both the extent and continuity of the 
research that has developed over the past decade from the early 
studies of rodent and primate exploration. From this vantage point, 
Me ag begin to take stock of the developments that have accumu- 
ated. 


ErrLrocue: THE SIGNIFICANCE OF 
EXPLORATION 

With a view toward the “mechanics” or “workings” of exploration, 
it would seem from our review of the literature that we are justified 
in promoting two principal tenets: whether through high drive or 
high arousal, the organism is motivated by exposure to homogene- 
ous, simple, restricted, and/or redundant stimulation; correspond- 
ingly, it will respond to and learn to work for stimulation that 
reduces its drive or arousal—that is, stimulation that is novel, un- 


familiar, complex, and/or changing. If we are to summarize these 
le picture, then that picture 


two tenets in a few words or with a sing nom 1 
is one of the organism needing, seeking, and processing information, 
not in the sense of receiving signals or stimulus input, but in the 
full theoretical sense of the word. 

The recency of work on exploratio 
sis of the behavior deal primarily with 
animals; in particular, rodents and prima 
not to limit the extent of our view. With 
findings on human exploration, indeed, even with the vagaries of 
our own behavior, we obtain a similar picture of the organism: 


n has required that our analy- 
the performance of subhuman 
tes. However, this seems 
the currently emerging 


74 Inquiry and Argument 


It is bored by the certainties of any humdrum job or routine enter- 
tainment. It seeks out the single moving spot on the landscape or the 
tiny squeak in the engine. It plays the slot machine to exhaustion, hoping 
for the rare and unpredictable payoff when the three lemons turn up. 
What it seeks in the variable light signals, and what it processes and 
responds to on all levels, is information—the changing, the novel, the 
surprising, and the uncertain.® 


This total view of the animal, responding to and for information on 
“all levels” of functioning, neural and behavioral as Platt (1961) 
argues, seems not unduly overdrawn. Consider our initial difficulty 
in defining exploration, a difficulty that arose out of the fact that 
“virtually all responses possess an exploratory function to some 
degree.” This observation, that exploration is a fundamental charac- 
teristic of the organism in all of its actions, would seem to reflect 
the significance and meaning, and the worth of our study, of the 
behavior. For within this framework, even those “basic” function- 
ings of the animal begin to take on new significance 


Hunger, for example, can be considered as a source of intense, persist- 
ent, little-changing, and very familiar stimulation; as such, it is dealt 
with by the animal in the same manner as any other monotonous stimu- 
lation, That is, the animal learns and/or performs those responses which 
are instrumental in removing this unchanging, intense stimulation or in 
providing new stimulation. In the case of persistent stimulation of external 
origin, e.g., the familiar maze arm, the animal, given the opportunity, 
seeks novel stimulation, e.g., by entering the other arm. In the case of 
hunger stimulation, the source of which the animal carries about with it, 
the most appropriate instrumental response is eating.7 


A similar interpretation seems to obtain with sexual behaviors. 
For example, recent work by Fisher (1962; see also Fowler and 
Whalen, 1961) indicates that the male rat ceases to copulate after 
extensive mating not because it is physically or “sexually” exhausted 
but, instead, because it is satiated with its female partner. When this 
partner (which serves as the incentive or goal object) is changed or 
varied, the mating is renewed, and with full and continuing 
vigor. These findings suggest, through the significance that they 
impart to both the exposure and change variables, that the initiation 


J. R. Platt, “Beauty: Pattern and Change,” in D. W, Fiske and S. R. Maddi 
(eds.), Functions of Varied Experience (Homewood, Ill.: Dorsey Publishing 
Company, 1961), 410. 

7H. Fowler, Joyce Blond, W. N. Dember, “Altemation Behavior and Learn- 
ing: The Influence of Reinforcement Magnitude, Number, and Contingency,” 
Journal of Comparative and Physiological Psychology, 1959, 52, 613. 
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and maintenance of sexual activities, even the preliminary sex play 
and grooming activities of Nissen’s (1953) virginal chimpanzees or 
the reinforcing effects of copulatory behavior for male rats not per- 
mitted to ejaculate (Sheffield, Wulff, and Backer, 1951), relate not 
to that obscure concept of a sex drive, but instead to the constancy 
of the animal’s exposure and existence and to the variation and 
change that is provided by sex play in all its forms from grooming 
and petting to copulation with or without the ejaculatory climax. 
Even our own patterns of sexual activity, in all of their variety, 
may reflect this search for and processing of information. The vicari- 
ous actions and accompanying “thrills” of the curious adolescent, 
the inquiring pursuits and more formal patterns of courtship dis- 
played by the teenager, even the satiations and cravings and “fanci- 
ful delights” of the experienced adult, with all of these we seem to 
view the human organism in its patterned and regulated strivings 
for variation and change. However, such “crass” activities need not 
shape or limit our view. Idle thought and occasional daydream, 
formal entertainment and light amusement, problem solution and 
invention, play and sports, knowledge and education, art and 
humor, all of these subject-events and their associated activities 
serve man well and reflect the nature of his functioning. And with 
these forms of “epistemic” curiosity on the one hand and, for lack 


of a better label, “playful” exploration on the other, our view is 
again of man in his need, his search for, and his processing of 


information. 

The formal span of the psychologist’s attention does not comprise 
at present so vast a panorama of subjects, but from his study of 
part, to understand these 


exploration he begins to consider and, in to T 
complex behaviors, and even those relatively “simple” ones such 


as twisting a paper clip out of shape, doodling, cracking one’s 
knuckles, and so forth, which Nissen (1954) noted. Indeed, he 
even seems to acquire some insight into his own functioning. 


The Exploratory Behavior of the Behavioral Scientist 

As a scientific investigator, the psychologist is also involved ina 
search for and processing of information; however, in this context, 
the term information relates to his knowledge of the workings and 
orderings of the universe, in particular, those “laws of nature” that 
are applicable to behavior. Because these laws, both by definition 
and presumption, do not change or vary, the psychologist’s task must 
entail a search for and a processing of the theoretical constancies 
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of behavior. But apparently the psychologist is no less subject to 
the dictates of exposure and change than any of the organisms that 
we have considered, for with his lengthy exposure (for the past 
40 years) to drive theory and the drive-reduction hypothesis, his 
more recent actions have often been indicative of a striving not for 
the constancies of behavior but for variation itself. Such a point 
seems all too well documented in the case of exploration and the 
conceptual developments that the study of this behavior has pro- 
moted. 

Our review of these developments has shown how, in reaction 
to the “inadequacies” of the drive theory of the forties, the early 
investigators of exploration proposed the “new” conceptualization 
of curiosity. But this concept had its own limitations, and soon a 
basis was laid both for the extension of contemporary drive theory 
and the development of the concept of optimal stimulation or 
arousal. In turn, this conceptualization has offered additional prob- 
lems that seem only to be resolved by equating the arousal concept 
with that of drive. And then, from the independent framework pro- 
vided by information theory, the drive concept presents itself once 
more. Thus with each step in this progression, we seem only to 
have moved closer to that initial formulation of behavior for which 
there was such jeopardy. This progression is particularly instructive, 
because it demonstrates how the findings that initially seem to 
contradict a general formulation like that of drive theory may then 
serve both to promote and support extended versions of the same 
formulation. The irony of such a development is sufficient for us 
to consider one final aspect of the nature of science, in particular, 
the manner in which former concepts are abandoned and new ones 
accepted. 

A concept like that of drive may and, in due time, probably will be 
succeeded by concepts that have greater interpretive and predictive 
utility. But contrary to expectation, this concept or any other will not 
be displaced by discrepant or contradictory evidence, because the 
findings that appear to be in opposition to the concept may relate in- 
stead to our failure to recognize the relevance of one or more vari- 
ables. In the context of exploration, one such variable seems to have 
been that of stimulus exposure (or, more specifically, length of stimu- 
lus exposure ), for with recognition of its potential motivating func- 
tion, contemporary drive theory may be extended and applied not 
only to exploratory phenomena but also to those other “simple” and 
complex behaviors considered above. All this, however, is really not 
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so new. As early as the 1920's, drive proponents like Carr (1925) 
Moss (1924), and Richter (1922, 1927) espoused the view that 
intense, persistent forms of stimulation served both to energize the 
animal’s behavior and to provide a basis for the learning of responses 
that led to a reduction of its drive. This view was partially formal- 
ized some 20 years later, when Miller and Dollard (1941) posited 
that the animal's level of drive and performance would be a func- 
tion of the intensity of its stimulation. Now, after some 40 years and 
a decade or more of research on exploration, it would seem that 
We are in a position to recognize that other drive-eliciting dimen- 
sion of the animal’s stimulation, that of its persistence, or perhaps 


more simply, its duration. 


PART TWO 


The Selected Readings 


Important Sources INCLUDED IN WHo te Or In Part 


CHAPTER I 


[ 1 ] J. F. Dashiell, “A Quantitative Demonstration of Animal Drive’ ai 

[ 2 ] W. Dennis, “Spontaneous Alternation in Rats as an Indicator 
the Persistence of Stimulus Effects” 

[ 3 ] H. F. Harlow, “Mice, Monkeys, Men, and Motives” 


CHAPTER II 


[4]K. C. Montgomery, “Exploratory Behavior as a Function of ‘Simi 
larity’ of Stimulus Situations” oga 

[ 5 ] M. Glanzer, “Stimulus Satiation: An Explanation of Spontane 
Alternation and Related Phenomena” n 

[6] W.N. Dember, “Response by the Rat to Environmental bowers a 

ETIA EK. Myers and N. E. Miller, “Evidence for Learning Motiva! 
by ‘Exploration’ ” 

CHAPTER III 


[ 8 ] R. A. Butler, “The Effect of Deprivation of Visual Incentives O0 
Visual Exploration Motivation in Monkeys” r 

[ 9 ] H. Levin and D. G, Forgays, “Learning as a Function of Sensory 
Stimulation of Various Intensities” 

[10] G. W, Barnes and A. Baron, “Stimulus Complexity and Sensory 
Reinforcement” 


[11] P. G. Zimbardo and N. E. Miller, “Facilitation of Exploration by 
Hunger in Rats” 


CHAPTER IV 


[12] C. Leuba, “Toward Some Integration of Learning Theories: The 
Concept of Optimal Stimulation” 


[13] D. O. Hebb, “Drives and the C.N.S. (Conceptual Nervous 
System)” 


[14] D. E. Berlyne, “Conflict and Information Theory Variables as 
Determinants of Human Perceptual Curiosity” 


[1] 
A Quantitative Demonstration of 
Animal Drive 


J. F. DASHIELL 


Latter-day developments of psychology have emphasized more 


and more the dynamic side, the analysis of the energizing and the 
pees of behavior, shown by the discussions of “emotion” and 
of “instinct,” and the current, additions to psychological vocabulary 


ase E ; 

~“drives” and “mechanisms,” “emotional facilitation,” “substitute 

Satisfaction,” “preparatory and consummatory reactions,” etc. 
ations for the clearer 


Unfortunately, the elaboration of demonstr: 
o students 


and more concrete presentation of these new concepts t 
methods is at present available. 


has lagged; and a very dearth o 

The reasons are multiple. It may be expected that sufficient simpli- 
fication and standardization of pioneer research methods will only 
follow at a distance the research work itself; but the very nature of 
the processes above referred to, being for the most part peculiarly 
Intra-organic and sub-peripheral and often dependent upon wide- 
Spread and slow-changing conditions of the total organism, makes 
their instrumentation and controlled demonstration decidedly more 


difficult than in the case of the simpler sensory, motor, and language- 


using functions. 

_In the interest of this general modification of technique for peda- 
Zogical purposes the writer offers an experience of his own. It was 
an attempt to make concrete for elementary students the point that 
an inner organic condition may serve as a drive to produce explora- 


tory behavior of a fairly continuous sort that is terminated typically 
only when a particular stimulus appears to arouse an end-reaction. 
Animals are decidedly more satisfactory subjects for such work than 
humans because their whole organic condition is easily controlled 
for experimental purposes. ‘And of the various drives hunger is the 
most conveniently manipulated. The writer has, then, employed 

source: J. F. Dashiell, “A Quantitative Demonstration of Animal Drive,” 
Journal of Comparative Psychology, 1925, 5, 205-208. Reprinted by permission 

Inc., and J. F. Dashiell. 


of the Williams and Wilkins Company, 
81 | 
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white rats in two comparison groups, a “hungry” and a “fed” or 
control group. 

A more troublesome part of a desirable demonstration than that 
of subject and drive control is that of the method of measuring the 
activity produced by the animal. The writer tried the revolving 
cage without success with white rats: the members of this species 
not climbing and whirling the drum as do squirrels, even sliding and 
tumbling when it is revolved from without. The idea of using a table 
placed delicately upon tambours as employed by Nicholls (1922) 
was given up after the technical difficulties of arranging it for large 


Ficure 1. 


class use became obvious. Recourse was had to a modified maze 
plan, with the idea of bringing out for quantitative observation the 
greater degree of exploratory behavior exhibited in the usual maze 
by the animal with the hunger incentive than that by an animal 
without this. The floor plan of the modified maze is presented in 
Figure 1. The whole floor was first lined off with dim lines 10 cm. 
apart in such a way as to produce square blocks of that dimension 
(represented by dotted lines in the figure). Outside partitions were 
then erected to form a completely enclosed space divided by other 
partitions into alley ways (partitions shown as continuous lines in 
the figure). The animal when introduced at E had several directions 
in which to turn and could proceed in an indefinite variety of ways. 
The marking off of the floor into blocks made possible a measure- 
ment of the subject’s total locomotor activity sufficiently exact for 
pedagogical purposes. (Of course, students can often note the 
greater activity of the hungry animals simply by general observa- 
tion, but for pedagogical reasons they should be trained to think 
always in quantitative terms. ) 
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TABLE l 


Showing Number of Blocks Entered by Individuals of the Two Groups 


“Fed” “Hungry” 

20 34 
29 36 

9 37 
24 47 
31 42 
11 42 
25 64 
32 38 
31 41 
30 72 
40 47 
34 37 
37 39 
26 81 
21 34 
36 46 

a o ee 
Totals 454 729 J 


Averages 26.7 


The above maze is simply planned and is easily constructed of 
wood floor with wood or metal partitions. The writer used a take- 
walls of black painted 


down form, with floor of cork composition, i 
h. The convenience of this 


galvanized iron, and top of wire mes l 
material has been elsewhere described (Stetson & Dashiell, 1919). 
In the procedure, the instructor handled the animals, and the 
by with copies of the maze 


members of the laboratory section stood e 
the gelatin type of duplicator) 


plan (easily run off in quantities with 

upon which they each traced in pencil the course followed by the 
rat, Rats from the “fed” and from the “hungry” groups were used 
alternately, each being given the same time in the enclosure, sixty 
seconds. After the laboratory work of the day each student inspected 
his tracings, counting the total number of blocks entered by each 
subject (“entered,” if one forefoot was set down over the line), and 
tabulating these to determine relative group scores. A sample table 
of results recently obtained from a class demonstration is given in 
Table 1. A definite tendency of the hunger-driven animals to show 
more restless activity is exhibited. The difference would doubtless 
be much greater were it not that the mere being-placed-in-a-new- 
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enclosure operates as something of a stimulus to set off exploratory 
reactions even in the non-hungry group. One who has handled 
white rats knows well enough that when these animals are returned 
to a renovated nest box they pay little or no attention to food placed 
there even though unfed for twenty-four hours, but give themselves 
up for a while to explorations over and through their new bedding. 
Whatever the finally assigned status for the “instinct of curiosity, 
it is undeniable that novelty in the environment is pretty sure to 
awaken “curious” behavior, 

An attempt was made to cancel this novelty or curiosity-drive 
factor by putting the animals daily into the enclosure for two weeks 
before the above demonstration, but other difficulties here presented 
themselves inasmuch as it was almost impossible to prevent some 
sort of conditioning or associating of this enclosure-situation to 
feeding and other responses. 

It goes without saying that quantitative variations of the above 
procedure can be made by testing animals of different degrees of 


` 


hunger, somewhat as done by Moss (1924). 


[2] 
Spontaneous Alternation in Rats as 


an Indicator of the Persistence 
of Stimulus Effects 


WAYNE DENNIS 


In 1934 Wingfield and Dennis found that when the rat is presented 
with two or more equally long paths to food and when it is offered 
two or more choices of pathways within a relatively short period of 
time, the animal on any trial after the first tends to avoid the path 
most recently traversed and to diversify its course to the goal. This 
may be called a tendency toward variability of routes. In the sim- 
plest situation, namely two paths and two successive trials, this 


source: Wayne Dennis, “Spontaneous Alternation in Rats as an Indicator 
of the Persistence of Stimulus Effects,” Journal of Comparative Psychology, 
1939, 28, 305-312. Reprinted by permission of the Williams and Wilkins 
Company, Inc., and W. Dennis. 
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tendency results in a rather consistent alternation between the two 
pathways. Because most of our work has been done with two path- 
ways, we shall speak of the rat’s behavior as alternation, although it 
is realized that in a wider sense the phenomenon is one of vari- 
ability, 

Since our first publication, we have found that spontaneous al- 
ternation in rats was described briefly by Tolman (1925a). We 
therefore wish to make this acknowledgment of Tolman’s priority. 
However, the phenomenon of spontaneous alternation seems to have 
played no part in Tolman’s systematic account of rat behavior 
(1982), i 

It is well-known, of course, that alternation habits of various sorts 
occasionally appear when the animal faces a difficult discrimination 
problem. Hunter (1920) has said that “the tendency toward simple 
alternation and the tendency to alternate after success have appeared 
so constantly in all difficult problems with the T-box, that it seems 
safe to affirm that these are innate reaction tendencies of the rat.” 
It may be remarked that under these same circumstances position 
habits also are formed. What determines the nature of the reaction 
in a difficult problem has not as yet been discovered. In our work, 
in which each of two paths leads to food, alternation has occurred 
in all animals and position habits have never appeared in a single 


subject, 
Carr (1917, 1919), Hunter (1920, 1930, 1931), Loucks (1931), 
lternation habits. It may seem 


and others have trained animals in a 
ve have found to be spontaneous 


anomalous that a response which v 
should require training. The work of these experimenters has differed 
from ours in this respect, that in their research the course of the 
rat was predetermined by the experimenter and any deviation from 
this route led to a blocking of certain pathways by the experimenter. 
Thus if the animal took the wrong pathway on any trial, it was then 
forced to traverse the correct one as well as the wrong one. In other 
words, on many trials both pathways were taken. It might be ex- 
pected that this would upset any natural tendency to alternate on 
successive trials. The forced alternation technique does not permit 
the rat to alternate its choices at all times but only when the animal's 
choices coincide with the predetermined alternations imposed by 
the experimenter. 

Subsequent to our first report of spontaneous alternation, the 
presence of the phenomenon has been checked in a variety of two- 
way maze situations. It has been found that spontaneous alternation 
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is as marked on the exploratory trials as it is after hundreds of 
practice runs (Dennis, 1935; Dennis & Sollenberger, 1934). It has ap- 
peared in all the kinds of alternative-choice situations which we 
have constructed, and these have been quite varied, Under a large 
number of experimental conditions, the characteristic frequency of 
alternations has been roughly 80 per cent, whereas chance behavior 
would result in alternation in only 50 per cent of the opportunities. 

The alternation phenomenon, we believe, has an important 
bearing upon several problems in animal psychology, but in the 
present instance we shall direct our evidence and our discussion 
chiefly to one problem. That is the question as to the extent to which 
the rat can carry over intraneurally the effects of the immediately 
preceding activity. 

The retention of the effects of individual stimuli was first sub- 
mitted to experimentation in the delayed reaction set-up (Hunter, 
1913). Since that time other procedures have been used for the 
same purpose. These have been the forced alternation problem, the 
temporal maze, and the double alternation box. All of the methods 
have rather generally agreed in exhibiting a low ability on the part 
of the rat to be guided in its behavior by a stimulus applied a few 
seconds prior to the behavior test, so that the picture of rat behavior 
which has been built up is that of a reaction system dominated almost 
solely by stimuli which are immediately present. 

The current methods of gathering evidence on this point are 
similar in this respect: that they impose a problem upon the animal 
without prior investigation of the animal’s spontaneous reaction 
tendencies. In spontaneous alternation the animal, without training, 
responds at the time of a second choice in large measure on the basis 
of the reaction made at the time of the first choice, The external 
situation remains the same between first and second choices. The 
difference between the first and the second choices can be explained 
only on the basis of some change within the animal. This change 
must have been initiated at the time of the first trial, and must have 
persisted throughout the interval. 

In this sense, any alternation is in some degree a delayed alterna- 
tion; that is, there must be an interval between trials, and the con- 
sequences of the first trial somehow bridge this interval. 


1 It may be suggested that on any trial after the first the rat is reacting to an 
olfactory trail laid down on the preceding trial. Control tests, involving the 
interchange of apparatus units, were made on this point in the study of Wing- 
field and Dennis. No evidence of such guidance was found. It should be noted 
that the animal would have to avoid the hypothetical trail. 
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It is not claimed that the spontaneous alternation technique is 
equivalent to the delayed reaction method. In the latter, the animal 
must respond to a previous cue which has been set by the experi- 
menter whereas the former depends upon the rats own previous 
behavior. In forced alternation problems, as in the delayed reaction 
problem, the rat in reality must respond in trials after the first to 
cues previously presented by the experimenter, for the only reliable 
cue on any trial after the first is some sort of “knowledge” as to 
which door was open and which was closed on the preceding trial. 

Using spontaneous alternation as an indicator, we have been in- 
terested in finding some of the conditions under which the effects 
of the first choice in a two-way apparatus will persist so as to cause 
a reversal of choice in the second trial. 

The animals used were two groups of rats, each group composed 
of twenty males of Wistar stock, between two and three months of 
age, and untrained at the beginning of the experiment. The general 
procedure, which was the same for the two groups, was as follows: 
the rat was placed twice in succession upon the apparatus and per- 
mitted at the end of each trial to take a very small quantity of a 
powdered diet (“Balra”) which was found in a small pan nailed to 
the end of the goal section of the apparatus. The animal was then 
returned to its cage, and the next rat was chosen. The entire group 
of animals was run in approximately an hour, whereupon the first 
subject was given another pair of trials, etc. Each subject in the 
course of a day received six or seven pairs of trials, consecutive 
pairs being separated by approximately one hour. This plan of ex- 
perimentation proved to be quite practicable, as will be shown by 
the results which follow. 

The basic pattern of the app 
elevated construction as shown in Figure 1. 
two feet on a side; the starting block and t 
one foot long, unless otherwise stated. 

For Group A the goal block was varie 
the interval between the two members of a pair of trials. The maxi- 
mum length used was 38 feet which was the capacity of laboratory. 
This meant that at times the subject had to run 38 feet of straight 

athway before receiving food and then had to be carried back to 
the starting point for the second trial. 

In Group A, each rat was first given 24 pairs of trials on the simple 
unit, yielding 480 possible alternations. Of these 82 per cent were 


realized. 


aratus was a hollow square of block 
Each hollow square was 
he goal block each were 


d in length in order to vary 
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Next, 14 feet of goal pathway were added and 6 pairs of runs 
given. Then 24 feet of pathway were employed and 5 pairs of trials 
were conducted. Finally the goal path consisted of 38 feet of path- 
way and 14 pairs of runs were required of each animal. The per- 


Ficure 1. 


centages of alternation for these trials were respectively 72, 78, and 
76. In other words, the time required for running 38 feet of addi- 
tional pathway plus the interval needed to carry the animal back to 
the starting point, did not appreciably affect the influence of the 
first choice upon the second. The interval between first and secon 

choices was timed by a stop watch, and for the experiment with the 
38 feet of additional straight-away the minimum time was 35 sec- 
onds; the median time was 105 seconds. , 

Group B began with a simple unit as did Group A. In 13 pairs 
of trials per animal, or 260 pairs of trials, the alternations were 
per cent of the opportunities to alternate, or a percentage almost 
identical with the record of Group A. 

Group B was then submitted to an arrangement of hollow-square 
units in tandem. The two-unit apparatus is shown in the right-han 
part of Figure 1. On a two-unit apparatus, 34 pairs of trials were 
given each animal. On a three-unit arrangement, each animal W 
given 10 pairs of trials. Finally, on a 10-unit apparatus, 12 pairs 0 
runs were given each subject. 

We are most interested in the two-unit apparatus, for with it the 


number of trials was very large (680 possible alternations) and the 
evidence is clear. 
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In these trials, there was only a chance relationship between the 
choices on unit A and the choices on unit B. In other words, the 
behavior upon unit B was not influenced by the choice in unit A. 
Of records showing a left choice in unit A, only 50 per cent showed 
a left choice in unit B, and similarly those who made a right choice 
in unit A divided their choices equally between the right and left 
sides of unit B. One might have expected centrifugal swing to 
operate so as to throw animals toward the side of unit B which 
was opposite to that which they traversed in unit A. That centrifu- 
gal swing did not operate is probably due to the fact that the path- 
ways were narrow (2 inches wide) and elevated. We are not 
acquainted with any evidence for the appearance of centrifugal 
swing on narrow elevated pathways. 

The facts just presented show that spontaneous alternation is not 
the result of a generalized tendency to turn in a direction opposite 
to a choice which has just been made, for if such were the case the 
choices in unit B should have been opposite in direction from those 
in unit A. 

The evidence shows that the alternation tendency is a tendency 
to avoid a specific pathway which has recently been traversed (on 
this point see also Wingfield and Dennis, 1934). In unit A and in 
unit B the second trip through the apparatus resulted in choices 
which were in the main contrary in direction in each unit to the 
choices made in the first trip, although as noted above, on either 
trip the choices in unit A and in unit B were independent of each 
other. As between first and second trials, the per cent of alternation 
was 75 for unit A and 72 for unit B. , 

These data show clearly that the result of the first trip through 
unit A is a tendency to avoid the same pathway when this particu- 
lar unit is again traversed, Likewise the tendency which is aroused 
in unit B is specific to that unit. There is no general tendency to 
take an opposite direction regardless of the position of the choice 
point. There is no effect of the first choice in unit A upon the first 
choice in unit B nor of the first choice in unit B upon the second 
choice in unit A. However, the first choice in either unit affects a 
second choice in the same unit. In other words it would appear that 
the animal is able to retain at least for many seconds two distinct 
reaction tendencies each aroused by a specific stimulus pattern and 
each released by a recurrence of its appropriate stimulus pattern. 
This represents a degree of “immediate memory” or of “persistence 
of stimulus effects” not previously exhibited in the rat by delayed 
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reaction techniques. It is similar to the multiple delayed reaction of 
some animals but there is this difference that the delayed reaction 
allows the completion of a reaction tendency which has been frus- 
trated whereas in the present case the second reaction consists in 
taking the pathway which was avoided on the first trial. Apparently 
no frustration has occurred. 

Naturally there is some limit to such an achievement. The break- 
down occurs when 3 or more units are used. The alternation in the 
3 units respectively was 67, 54, 52 per cent. The first is reliably 
better than chance performance, but the second and third are 
almost identical with chance expectations. g 

When 10 units were arranged in a series, the behavior on no unit 
was reliably different from chance expectation, but the per cent of 
alternation became rather consistently less from the early to the 
later units. The percentages were respectively as follows: 59, 55, 
52, 61, 55, 47, 45, 45, 38, 36. 


SUMMARY AND DISCUSSION 

Evidence has been presented which shows that a choice of path- 
ways by the rat will influence a later choice at the same point even 
if an interval of more than a minute separates the two choices. The 
temporal limit of this influence was not determined. 

A choice influences a second choice at the same spot in the appa- 
ratus, even though a choice elsewhere in the apparatus has inter- 
vened. However, a choice at one point in the present apparatus had 
no effect upon a subsequent choice in another section of the ap- 
paratus. 

The situation in spontaneous alternation differs from forced delay 
problems in that the rat in spontaneous alternation shows evidence 
of some sort of retention of its spontaneous activity whereas in the 
forced delay problem the animal must retain the effects of a cue 
which has been given by the experimenter. 

The phenomenon of spontaneous alternation shows that the rat, 
without training, may respond to a choice situation in part on the 
basis of its preceding activity. The rat’s choice of pathway is not 
always determined by stimuli which are acting upon the sense 
organs at the moment but may be guided in part by events which 
preceded the choice by an interval at least one minute in length and 
perhaps by longer periods. 


[3] 
Mice, Monkeys, Men, and Motives * 
HARRY F. HARLOW 


Many of psychology’s theoretical growing pains—or, in modern 
terminology, conditioned anxieties—stem from the behavioral revo- 
lution of Watson. The new psychology intuitively disposed of 
instincts and painlessly disposed of hedonism. But having completed 
this St. Bartholomew-type massacre, behavioristic motivation theory 
was left with an aching void, a nonhedonistic aching void, needless 
to say. 

Before the advent of the Watsonian scourge the importance of 
external stimuli as motivating forces was well recognized. Psycholo- 
gists will always remain indebted to Loeb’s (1918) brilliant for- 
mulation of tropistic theory, which emphasized, and probably 
overemphasized, the powerful role of external stimulation as the 
primary motivating agency in animal behavior. Unfortunately, Loeb’s 
premature efforts to reduce all behavior to overly simple mathemati- 
cal formulation, his continuous acceptance of new tropistic constructs 
in an effort to account for any aberrent behavior ‘not easily inte- 
grated into his original system, and his abortive attempt to en- 
compass all behavior into a miniature theoretical system doubtless 
led many investigators to underestimate the value of his experi- 
mental contributions. 

Thorndike (1911) was simultaneously giving proper emphasis to 
the role of external stimulation as a motivating force in learning 
and learned performances. Regrettably, these motivating processes 
were defined in terms of pain and pleasure, and it is probably best 
for us to dispense with such lax, ill-defined, subjective terms as 
pain, pleasure, anxiety, frustration, and hypotheses—particularly in 
descriptive and theoretical rodentology. 

* This paper was presented September 3, 1951, as the presidential address of 


the Division of Experimental Psychology at the Chicago meetings of the Ameri- 
can Psychological Association. 


source: Harry F. Harlow, “Mice, Monkeys, Men, and Motives,” Psychologi- 
cal Review, 1953, 60, 23-32. Reprinted by permission of the American Psycho- 
logical Association and H. F. Harlow. 
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Instinct theory, for all its terminological limitations, put proper 
emphasis on the motivating power of external stimuli; for, as so 
brilliantly described by Watson in 1914, the instinctive response was 
elicited by “serial stimulation,” much of which was serial external 
stimulation. 

The almost countless researches on tropisms and instincts might 
well have been expanded to form a solid and adequate motiva- 
tional theory for psychology—a theory with a proper emphasis on 
the role of the external stimulus and an emphasis on the importance 
of incentives as opposed to internal drives per se. 

It is somewhat difficult to understand how this vast and valuable 
literature was to become so completely obscured and how the im- 
portance of the external stimulus as a motivating agent was to 
become lost. Pain-pleasure theory was discarded because the ter- 
minology had subjective, philosophical implications. Instinct theory 
fell into disfavor because psychologists rejected the dichotomized 
heredity-environment controversy and, also, because the term “in- 
stinct” had more than one meaning. Why tropistic theory disap- 
peared remains a mystery, particularly inasmuch as most of the 
researches were carried out on subprimate animal forms. 

Modern motivation theory apparently evolved from an over- 
popularization of certain experimental and theoretical materials. 
Jennings’ (1906) demonstration that “physiological state” played ʻa 
role in determining the behavior of the lower animal was given 
exaggerated importance and emphasis, thereby relegating the role 
of external stimulation to a secondary position as a force in motiva- 
tion. The outstanding work in the area of motivation between 1920 
and 1930 related to visceral drives and drive cycles and was popu- 
larized by Richter’s (1927) idealized theoretical paper on “Animal 


Behavior and Internal Drives” and Cannon’s (1932) The Wisdom 
of the Body. 


are those that will survive the test of time. 
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It is my belief that the theory which describes learning as depend- 
ent upon drive reduction is false, that internal drive as such is a 
variable of little importance to learning, and that this small impor- 
tance steadily decreases as we ascend the phyletic scale and as we 
investigate learning problems of progressive complexity. Finally, 
it is my position that drive-reduction theory orients learning psychol- 
ogists to attack problems of limited importance and to ignore the 
fields of research that might lead us in some foreseeable future time 
to evolve a theoretical psychology of learning that transcends any 
single species or order. 

There can be no doubt that the single-celled organisms such as 
the amoeba and the paramecium are motivated to action both by 
external and internal stimuli. The motivation by external stimulation 
gives rise to heliotropisms, chemotropisms, and theotropisms. The 
motivation by internal stimulation produces characteristic physio- 
logical states which have, in turn, been described as chemotropisms. 
From a phylogenetic point of view, moreover, neither type of motive 
appears to be more basic or more fundamental than the other, Both 
types are found in the simplest known animals and function in inter- 
active, rather than in dominant-subordinate, roles. 

Studies of fetal responses in animals from opossum to man give 
no evidence suggesting that the motivation of physiological states 
precedes that of external incentives. Tactual, thermal, and even 
auditory and visual stimuli elicit complex patterns of behavior in 
the fetal guinea pig, although this animal has a placental circulation 
which should guarantee against thirst or hunger (Carmichael, 1934). 
The newborn opossum climbs up the belly of the female and into 
the pouch, apparently in response to external cues; if visceral mo- 
tives play any essential role, it is yet to be described (Langworthy, 
1928). The human fetus responds to external tactual and nociceptive 
stimuli at a developmental period preceding demonstrated hunger 
or thirst motivation. Certainly, there is no experimental literature 
to indicate that internal drives are ontogenetically more basic than 
exteroceptive motivating agencies. 

Tactual stimulation, particularly of the cheeks and lips, elicits 
mouth, head, and neck responses in the human neonate, and there 
are no data demonstrating that these responses are conditioned, or 
even dependent, upon physiological drive states. Hunger appears 
to lower the threshold for these responses to tactual stimuli. Indeed, 
the main role of the primary drive seems to be one of altering the 
threshold for precurrent responses. Differentiated sucking response 
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patterns have been demonstrated to quantitatively varied thermal 
and chemical stimuli in the infant only hours of age (Jensen, 1932), 
and there is, again, no reason to believe that the differentiation 
could have resulted from antecedent tissue-tension reduction states. 
Taste and temperature sensations induced by the temperature and 
chemical composition of the liquids seem adequate to account for 
the responses. x 

There is neither phylogenetic nor ontogenetic evidence that drive 
states elicit more fundamental and basic response patterns than do 
external stimuli; nor is there basis for the belief that precurrent 
responses are more dependent upon consummatory responses than 
are consummatory responses dependent upon precurrent responses. 
There is no evidence that the differentiation of the innate precurrent 
responses is more greatly influenced by tissue-tension reduction than 
are the temporal ordering and intensity of consummatory responses 
influenced by conditions of external stimulation. 

There are logical reasons why a drive-reduction theory of paal 
ing, a theory which emphasizes the role of internal, physiologica 
state motivation, is entirely untenable as a motivational theory © 
learning. The internal drives are cyclical and operate, certainly at 
any effective level of intensity, for only a brief fraction of any 
organism’s waking life. The classical hunger drive physiologically 
defined ceases almost as soon as food—or nonfood—is ingested. This, 
as far as we know, is the only case in which a single swallow PO 
tends anything of importance. The temporal brevity of operation © 
the internal drive states obviously offers a minimal opportunity for 
conditioning and a maximal opportunity for extinction. The human 
being, at least in the continental United States, may go for days OY 
even years without ever experiencing true hunger or thirst. If his 
complex conditioned responses were dependent upon primary drive 
reduction, one would expect him to regress rapidly to a state of tui- 
tional oblivion. There are, of course, certain recurrent physiological 
drive states that are maintained in the adult. But the studies of 
Kinsey (1948) indicate that in the case of one of these there is aD 
inverse correlation between presumed drive strength and scope and 
breadth of learning, and in spite of the alleged reading habits of 
the American public, it is hard to believe that the other is our major 
source of intellectual support. Any assumption that derived drives 
or motives can account for learning in the absence of primary drive 
reduction puts an undue emphasis on the strength and permanence 
of derived drives, at least in subhuman animals. Experimental 
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studies to date indicate that most derived drives (Miller, 1951) and 
second-order conditioned responses (Pavlov, 1927) rapidly extin- 
guish when the rewards which theoretically reduce the primary 
drives are withheld. The additional hypothesis of functional auton- 
omy of motives, which could bridge the gap, is yet. to be demon- 
strated experimentally. 

The condition of strong drive is inimical to all but very limited 
aspects of learning—the learning of ways to reduce the internal 
tension. The hungry child screams, closes his eyes, and is apparently 
oblivious to most of his environment. During this state he eliminates 
response to those aspects of his environment around which all his 
important learned behaviors will be based. The hungry child is a 
most incurious child, but after he has eaten and become thoroughly 
sated, his curiosity and all the learned responses associated with his 
curiosity take place. If this learning is conditioned to an internal 
drive state, we must assume it is the resultant of backward condi- 
tioning. If we wish to hypothesize that backward conditioning is 
dominant over forward conditioning in the infant, it might be pos- 
sible to reconcile fact with S-R theory. It would appear, however, 
that alternate theoretical possibilities should be explored before the 
infantile backward conditioning hypothesis is accepted. 

Observations and experiments on monkeys convinced us that there 
was as much evidence to indicate that a strong drive state inhibits 
learning as to indicate that it facilitates learning. It was the speak- 
er’s feeling that monkeys learned most efficiently if they were given 
food before testing, and as a result, the speaker routinely fed his 
subjects before every training session. The rhesus monkey is 
equipped with enormous cheek pouches, and consequently many 
subjects would begin the educational process with a rich store of 
incentives crammed into the buccal cavity. When the monkey made 
a correct response, it would add a raisin to the buccal storehouse 
and swallow a little previously munched food. Following an incor- 
rect response, the monkey would also swallow a little stored food. 
Thus, both correct and incorrect responses invariably resulted in 
S-R theory drive reduction. It is obvious that under these conditions 
the monkey cannot learn, but the present speaker developed an 
understandable skepticism of this hypothesis when the monkeys 
stubbornly persisted in learning, learning rapidly, and learning 
problems of great complexity. Because food was continuously avail- 
able in the monkey’s mouth, an explanation in terms of differential 
fractional anticipatory goal responses did not appear attractive. It 
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would seem that the Lord was simply unaware of drive-reduction 
learning theory when he created, or permitted the gradual evolu- 
tion of, the rhesus monkey. 

The langurs are monkeys that belong to the only family of 
primates with sacculated stomachs. There would appear to be no 
mechanism better designed than the sacculated stomach to induce 
automatically prolonged delay of reinforcement defined in terms of 
homeostatic drive reduction, Langurs should, therefore, learn with 
great difficulty. But a team of Wisconsin students has discovered 
that the langurs in the San Diego Zoo learn at a high level of 
monkey efficiency. There is, of course, the alternative explanation 
that the inhibition of hunger contractions in multiple stomachs is 
more reinforcing than the inhibition of hunger contractions in one. 
Perhaps the quantification of the gastric variable will open up great 
new vistas of research. 

Actually, the anatomical variable of diversity of alimentary mech- 
anisms is essentially uncorrelated with learning to food incentives 
by monkeys and suggests that learning efficiency is far better re- 
lated to tensions in the brain than in the'belly. 

Experimental test bears out the fact that learning performance by 
the monkey is unrelated to the theoretical intensity of the hunger 
drive. Meyer ( 1951) tested rhesus monkeys on discrimination-learn; 
ing problems under conditions of maintenance-food deprivation Q 
1.5, 18.5, and 22.5 hours and found no significant differences 1° 
learning or performance. Subsequently, he tested the same i as 
keys on discrimination-reversal learning following 1, 23, and 4 
hours of maintenance-food deprivation and, again, found no signifi- 
cant differences in learning or in performance as measured by 
activity, direction of activity, or rate of responding. There was 
some evidence, not statistically significant, that the most famished 
subjects were a bit overeager and that intense drive exerted a mildly 
inhibitory effect on learning efficiency. 

Meyers data are in complete accord with those presented by 
Birch (1945), who tested six young chimpanzees after 2, 6, 12, 24 
and 48 hr. of food deprivation and found no significant differences 
in proficiency of performance on six patterned string problems. 
Observational evidence led Birch to conclude that intense food 
deprivation adversely affected problem solution because it led the 
chimpanzee to concentrate on the goal to the relative exclusion of 
the other factors. 

It may be stated unequivocally that, regardless of any relation- 
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ship that may be found for other animals, there are no data indi- 
cating that intensity of drive state and the presumably correlated 
amount of drive reduction are positively related to learning efficiency 
in primates. 

In point of fact there is no reason to believe that the rodentological 
data will prove to differ significantly from those of monkey, chim- 
panzee, and man. Strassburger (1950) has recently demonstrated 
that differences in food deprivation from 5 hours to 47 hours do not 
differentially affect the habit strength of the bar-pressing response 
as measured by subsequent resistance to extinction. Recently, Shef- 
field and Roby (1950) have demonstrated learning in rats in the 
absence of primary drive reduction. Hungry rats learned to choose 
a maze path leading to a saccharin solution, a nonnutritive sub- 
stance, in preference to a path leading to water. No study could 
better illustrate the predominant role of the external incentive-type 
stimulus on the learning function. These data suggest that, following 
the example of the monkey, even the rats are abandoning the sink- 
ing ship of reinforcement theory, 

The effect of intensity of drive state on learning doubtless varies 
as we ascend the phyletic scale and certainly varies, probably. to 
the point of almost complete reversal, as we pass from simple to 
complex problems, a point emphasized some years ago in a theoreti- 
cal article by Maslow (1943). Intensity of nociceptive stimulation 
may be positively related to speed of formation of conditioned 
avoidance responses in the monkey, but the use of intense nocicep- 
tive stimulation prevents the monkey from solving any problem of 
moderate complexity. This fact is consistent with a principle that 
was formulated and demonstrated experimentally many years ago 
as the Yerkes-Dodson law (1908). There is, of course, no reference 
to the Yerkes-Dodson law by any drive-reduction theorist. 

We do not mean to imply that drive state and drive-state reduc- 
tion are unrelated to learning; we wish merely to emphasize that 
they are relatively unimportant variables. Our primary quarrel with 
drive-reduction theory is that it tends to focus more and more 
attention on problems of less and less importance. A strong case 
can be made for the proposition that the importance of the psycho- 
logical problems studied during the last fifteen years has decreased 
as a negatively accelerated function approaching an asymptote of 
complete indifference. Nothing better illustrates this point than the 
kinds of apparatus currently used in “learning” research. We have the 
single-unit T-maze, the straight runway, the double-compartment 
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grill box, and the Skinner box. The single-unit T-maze is an 
ideal apparatus for studying the visual capacities of a nocturnal 
animal; the straight runway enables one to measure quantitatively 
the speed and rate of running from one dead end to another; the 
double-compartment grill box is without doubt the most efficient 
torture chamber which is stil] legal; and the Skinner box enables 
one to demonstrate discrimination learning in a greater number of 
trials than is required by any other method, But the apparatus, 
though inefficient, give rise to data which can be splendidly quanti- 
fied. The kinds of learning problems which can be efficiently 
measured in these apparatus represent a challenge only to the 
decorticate animal. It is a constant source of bewilderment to me 
that the neobehaviorists who so frequently belittle physiological 
psychology should choose apparatus which, in effect, experimentally 
decorticate their subjects. 

The Skinner box is a splendid apparatus for demonstrating that 
the rate of performance of a learned response is positively related 
to the period of food deprivation. We have confirmed this for the 
monkey by studying rate of response on a modified Skinner box 
following 1, 23, and 47 hr. of food deprivation. Increasing length of 
food deprivation is clearly and positively related to increased rate 
of response. This functional relationship between drive states and 
responses does not hold, as we have already seen, for the monkey $ 
behavior in discrimination learning or in acquisition of any more 
complex problem. The data, however, like rat data, are in complete 
accord with Crozier’s (1929) finding that the acuteness of the 
radial angle of tropistic movements in the slug Limax is positively 
related to intensity of the photic stimulation. We believe there is 
generalization in this finding, and we believe the generalization to 
be that the results from the investigation of simple behavior may 
be very informative about even simpler behavior but very seldom 
are they informative about behavior of greater complexity. I do not 
want to discourage anyone from the pursuit of the psychological 
Holy Grail by the use of the Skinner box, but as far as I am con- 
cerned, there will be no moaning of farewell when we have passed 
the pressing of the bar. 

In the course of human events many psychologists have children, 
and these children always behave in accord with the theoretical 
position of their parents. For Purposes of scientific objectivity the 
boys are always referred to as “Johnny” and the girls as “Mary. 
For some eleven months I have been observing the behavior of 
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Mary X. Perhaps the most striking characteristic of this particular 
primate has been the power and persistence of her curiosity-investi- 
gatory motives. At an early age Mary X demonstrated a positive 
valence to parental thygmotatic stimulation. My original interpreta- 
tion of these tactualthermal erotic responses as indicating parental 
affection was dissolved by the discovery that when Mary X was 
held in any position depriving her of visual exploration of the en- 
vironment, she screamed; when held in a position favorable to 
visual exploration of the important environment, which did not 
include the parent, she responded positively. With the parent and 
position held constant and visual exploration denied by snapping 
off the electric light, the positive responses changed to negative, 
and they returned to positive when the light was again restored. 
This behavior was observed in Mary X, who, like any good Watson 
child, showed no “innate fear of the dark.” 

The frustrations of Mary X appeared to be in large part the 
results of physical inability to achieve curiosity-investigatory goals. 
In her second month, frustrations resulted from inability to hold 
up her head indefinitely while lying prone in her crib or on a mat 
and the consequent loss of visual curiosity goals. Each time she had 
to lower her head to rest, she cried lustily. At nine weeks attempts 
to explore (and destroy) objects anterior resulted in wriggling 
backward away from the lure and elicited violent negative responses. 
Once she negotiated forward locomotion, exploration set in, in earn- 
est, and, much to her parents’ frustration, shows no sign of diminish- 
ing. 

Can anyone seriously believe that the insatiable curiosity-investi- 
gatory motivation of the child is a second-order or derived drive 
conditioned upon hunger or sex or any other internal drive? The 
S-R theorist and the Freudian psychoanalyst imply that such be- 
haviors are based on primary drives. An informal survey of neo- 
behaviorists who are also fathers (or mothers) reveals that all have 
observed the intensity and omnipresence of the curiosity-investiga- 
tory motive in their own children. None of them seriously believes 
that the behavior derives from a second-order drive. After describing 
their children’s behavior, often with a surprising enthusiasm and 
frequently with the support of photographic records, they trudge 
off to their laboratories to study, under conditions of solitary con- 
finement, the intellectual processes of rodents. Such attitudes, per- 
fectly in keeping with drive-reduction theory, no doubt account 
for the fact that there are no experimental or even systematic 
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observational studies of curiosity-investigatory-type external-incen- 
tive motives in children. 

A key to the real learning theory of any animal species is knowl- 
edge of the nature and organization of the unlearned patterns of 
response. The differences in the intellectual capabilities of cock- 
roach, rat, monkey, chimpanzee, and man are as much a function 
of the differences in the inherent patterns of response and the 
differences in the inherent motivational forces as they are a function 
of sheer learning power. The differences in these inherent patterns 
of response and in the motivational forces will, I am certain, prove 
to be differential responsiveness to external stimulus patterns. 
Furthermore, I am certain that the variables which are of true, as 
Opposed to Psychophilosophical, importance are not constant hon 
learning problem to learning problem even for the same anima 
order, and they are vastly diverse as we pass from one animal order 
to another, 

Convinced that the key to human learning is not the conditioned 
response but, rather, motivation aroused by external stimuli, the 
speaker has initiated researches on curiosity-manipulation behavior 
as related to learning in monkeys (Davis, Settlage, & Harlow, 1950; 
Harlow, 1950; Harlow, Harlow, & Meyer, 1950). The justification 
for the use of monkeys is that we have more monkeys than children. 
Furthermore, the field is so unexplored that a systematic vee pA 
tion anywhere in the phyletic scale should prove of methodologica 
value. The rhesus monkey is actually a very incurious and nonma- 
nipulative animal compared with the anthropoid apes, which are, 
in turn, very incurious nonmanipulative animals compared with pee 
It is certainly more than coincidence that the strength and range o. 
curiosity-manipulative motivation and position within the primate 
order are closely related. 

We have presented three studies which demonstrate that monkeys 
can and do learn to solve mechanical puzzles when no motivation is 
provided other than presence of the puzzle. Furthermore, we have 
presented data to show that once mastered, the sequence of manipu- 
lations involved in solving these puzzles is carried out relatively 
flawlessly and extremely persistently. We have presented what we 
believe is incontrovertible evidence against a second-order drive 
interpretation of this learning. p 

A fourth study was carried out recently by Gately at the Wis- 
consin laboratories. Gately directly compared the behavior of two 
groups of four monkeys presented with banks of four identical 
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mechanical puzzles, each utilizing three restraining devices. All four 
food- plus puzzle-rewarded monkeys solved the four identical puz- 
zles, and only one of the four monkeys motivated by curiosity alone 
solved all the puzzles. This one monkey, however, learned as rapidly 
and as efficiently as any of the food-rewarded monkeys. But I wish 
to stress an extremely important observation made by Gately and 
supported by quantitative records. When the food-rewarded mon- 
keys had solved a puzzle, they abandoned it. When the nonfood- 
rewarded animals had solved the puzzle, they frequently continued 
their explorations and manipulations. Indeed, one reason for the 
nonfood-rewarded monkeys’ failure to achieve the experimenter’s 
concept of solution lay in the fact that the monkey became fixated 
in exploration and manipulation of limited puzzle or puzzle-device 
components. From this point of view, hunger-reduction incentives 
may be regarded as motivation-destroying, not motivation-support- 
ing, agents. 

Twenty years ago at the Vilas Park Zoo, in Madison, we observed 
an adult orangutan given two blocks of wood, one with a round 
hole, one with a square hole, and two plungers, one round and one 
square, Intellectual curiosity alone led it to work on these tasks, 
often for many minutes at a time, and to solve the problem of in- 
serting the round plunger in both holes. The orangutan never solved 
the problem of inserting the square peg into the round hole, but 
inasmuch as it passed away with perforated ulcers a month after the 
problem was presented, we can honestly say that it died trying. And 
in defense of this orangutan, let it be stated that it died working on 
more complex problems than are investigated by most present-day 
learning theorists. 

Schiller? has reported that chimpanzees solve multiple-box- 
stacking problems without benefit of food rewards, and he has 
presented observational evidence that the joining of sticks resulted 


from manipulative play responses. 
The Cebus monkey has only one claim to intellectual fame—an 


ability to solve instrumental problems that rivals the much publi- 
cized ability of the anthropoid apes (Harlow, 1951; Kliiver, 1933). 
It can be no accident that the Cebus monkey, inferior to the rhesus 
on conventional learning tasks, demonstrates far more spontaneous 
instrumental-manipulative responses than any old-world form. The 
complex, innate external-stimulus motives are variables doubtlessly 
as important as, or more important than, tissue tensions, stimulus 


2 Personal communication. 
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generalization, excitatory potential, or secondary reinforcement. It 

s the oscillation of sticks, not cortical neurons, that enables the 

Cebus monkey to solve instrumental problems. £ 

No matter how important may be the analysis of the curiosity- 
manipulative drives and the learning which is associated with them, 
we recognize the vast and infinite technical difficulties that are in- 
herent in the attack on the solution of these problems—indeed, it 
may be many years before we can routinely order such experiments 
in terms of latin squares and factorial designs, the apparent sine 
qua non for publication in the Journal of Experimental Psychology 
and the Journal of Comparative and Physiological Psychology. 

There is, however, another vast and important area of external- 
stimulus incentives important to learning which has been explored 
only superficially and which can, and should, be immediately and 
systematically attacked by rodentologists and primatologists alike. 
This is the area of food incentives—or, more broadly, visuo-chemo 
variables—approached from the point of view of their function as 
motivating agents per se. This function, as the speaker sees it, 3s 
primarily an affective one and only secondarily one of tissue-tension 
reduction. To dispel any fear of subjectivity, let us state that the 
affective tone of food incentives can probably be scaled by prefer- 
ence tests with an accuracy far exceeding any scaling of tissue tene 
sions. Our illusion of the equal-step intervals of tissue tensions ` 
the myth that length of the period of deprivation is precisely — 
to tissue-tension intensity, but the recent experiments by Koch an 
Daniel (1945) and Horenstein (1951) indicate that this is not true, 
thus beautifully confirming the physiological findings of thirty years 
ago. 

n techniques with monkeys show beyond ques- 
tion that the primary incentive variables of both differential quan- 
tity and differential quality can be arranged on equal-step scales, 
and there is certainly no reason to believe that variation dependent 
upon subjects, time, or experience is greater than that dependent 
upon physiological hunger. 

In defense of the rat and its protagonists, let it be stated that 
there are already many experiments on this lowly mammal which 
indicate that its curiosity-investigatory motives and responsiveness 


experiments of Buxton (1940), Haney ( 1931), Seward, Levy, and 
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tory drive of the rat. Keller (1941) and Zeaman and House (1950) 
have utilized the rat’s inherent aversion to light, or negative helio- 
tropistic tendencies, to induce learning. Flynn and Jerome (1952) 
have shown that the rat’s avoidance of light is an external-incentive 
motivation that may be utilized to obtain the solution of complex 
learned performances. For many rats it is a strong and very persistent 
form of motivation. The importance of incentive variables in rats 
has been emphasized and re-emphasized by Young (1949), and the 
influence of incentive variables on rat learning has been demon- 
strated by Young (1949), Zeaman (1949), Crespi (1942), and 
others. I am not for one moment disparaging the value of the rat 
as a subject for psychological investigation; there is very little wrong 
with the rat that cannot be overcome by the education of the ex- 
perimenters. 

It may be argued that if we accept the theses of this paper, we 
shall be returning to an outmoded psychology of tropisms, instincts, 
and hedonism. There is a great deal of truth to this charge. Such an 
approach might be a regression were it not for the fact that psychol- 
ogy now has adequate techniques of methodology and analysis to 
attack quantifiably these important and neglected areas. If we are 
ever to have a comprehensive theoretical psychology, we must at- 
tack the problems whose solution offers hope of insight into human 
behavior, and it is my belief that if we face our problems honestly 
and without regard to, or fear of, difficulty, the theoretical psychol- 
ogy of the future will catch up with, and eventually even surpass, 
common sense. 


JL, Calcutta db / 
me a 7 
2 Bei 

oot * 


[4] 

Exploratory Behavior as a Function of 
“Similarity” of Stimulus Situations * ° 
K. C. MONTGOMERY 


The hypothesis of exploratory drive, developed by the writer 
(Montgomery 1951a, 1951b, 1952b), states (a) that a novel stimulus 


The present experiment is a more detailed investigation of this 
phenomenon. It is hypothesized (a) that the decrement in ex- 


xposure to one stimulus situation 
generalizes to other situations, and (b) that 


* An abbreviated version of this aper wa: er 
in Atlantic City, N.J., in March, 19s, P S presented at the EPA meeting: 

2 This research was conducted at Cornell University, 

2 Mr. Louis DiMarco ran the animals in the Preliminary investigation 

source: K. C. Montgomery, “Explorato: Behavi a nk 
otal ee al "Co 2 Tineton of Si 
Peychology, 1953, 26, Wage Reprinted by Permission of the American 
Psychological Association. 
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situations decreases. Stated differently, as the difference between 
two consecutive stimulus situations increases, the amount of recovery 
of exploratory behavior in the second situation also increases. Sim- 
ilarity is varied in the present study by using mazes of three degrees 
of luminance. 


METHOD 


Subjects 
Thirty-two female rats of the Wistar strain, about 100 days old and 
experimentally naive, were used as Ss. 


Apparatus 

The apparatus consisted of three enclosed mazes, identical except for 
brightness. One was painted flat black, one flat white, and one an inter- 
mediate flat gray, and their mean brightnesses were 0.18, 0.55, and 8.30 
ft.-L, respectively. Each maze was constructed in the form of an H. Each 
arm of the H was 24 in. long, 4 in. wide, and 4 in. high (inside measure- 
ments), and was covered with hardware cloth. The mazes were placed 
close together on the floor of a 10-ft. square enclosure formed by black 
curtains. Illumination was provided by a single 60-w. bulb suspended 
5% ft. above the center of the floor of the enclosure. This setting provided 
relatively homogeneous extramaze stimulation. The E sat in one corner 
of the enclosure while observing the maze behavior. 


Procedure 

Before and during the three days of the experiment all animals were 
allowed free access to both food and water except during the 10 to 15 
min. per day when they were actually in the maze. Four rats were 
assigned at random to each of eight groups. Each group received a differ- 
ent sequence of maze-exposures. Table 1 shows the experimental design. 

On day 1 the animals were permitted to explore one maze freely for 
5 min., then, after a 5-min. rest period, were allowed to explore a second 
maze for 5 min, The first maze was black for 12 rats, gray for 8, and white 
for 12; the second maze was black for 12 rats, gray for 8, and white for 
12. Thus, the effect of maze luminance on amount of exploratory behavior 
can be determined. A 

On days 2 and 3 the design is somewhat more complicated. Groups 
I-A through IV-A were exposed to one maze for 10 min., then to a test 
maze for 5 min.; Groups I-B through IV-B were exposed to one maze for 
5 min., then to a test maze for 10 min. The intermaze interval was about 
10 sec. for all animals on both days. Thus, the influence of length of 
exposure to the first maze upon amount of exploratory behavior in the 
test mazes can be determined. Also, the change in maze luminance from 
the first to the test maze was varied systematically, in a counterbalanced 
order, among the groups. This makes it possible to evaluate the effect of 
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exposure to a maze of each degree of luminance upon amount of explora- 
tory behavior in test mazes of all three degrees of luminance. p 
On all days amount of exploratory behavior was measured by recording 
the total number of 12-in. sections explored during each minute of expo- 
sure. The criterion of a maze-section exploration was a full body-length 


entry, excluding the rat’s tail. 
TABLE 1 


Experimental Design 


es 


Group 
Day Er pocita CIA mA mA VA 
me 
A UA AA 
ae b a b a b a 4 
n l È gb r b r l, 
1 5 BWW GB e B8 W 
5 w B G w res B wW R 
10’ B B W WwW B B E W 
23 5 ww CG è ® G B W 
=E Yw e 8 e¢ ee #. 
Group 
Day Exposure CIB muB mB VB 
Time — 
a b a b a b & R 
-M 
5 wW B G W G B w B 
1 d w 
5 B W w G B G B 
5 w w G G G G B W 
2-3 10° B B W W B B B W 


° Each subgroup (a, b) contains two rats. 


RESULTS 


The data are analyzed to provide answers to five questions. First, 
does maze luminance bear any relation to amount of exploratory 
behavior? Figure 1 shows the average number of 12-in, sections ex- 
plored plotted against minutes of exposure for the black, gray, and 
white mazes on day 1. Plots are presented for first exposure, for 
second exposure (after the 5-min. rest period), and for both ex- 
posures. There are no systematic differences attributable to maze 
luminance. Similar results obtain for days 2 and 3 when the first 
5 min. of exposure are considered. 

Second, are the groups homogeneous with respect to amount of 
exploratory behavior? Table 2 presents the mean number of 12-in. 
sections explored by each subgroup during the 10 min. of explora- 
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MINUTES 


BOTH EXPOSURES 


MEAN NUMBER OF 12 INCH SECTIONS EXPLORED 


MINUTES 
in. sections explored as a function of time of 


Ficure 1. Mean number of 12 
exposure for each maze luminance on day 1. 


tion on day 1. No systematic differences are apparent. Analysis of 
variance confirms the conclusion that there are no significant differ- 
ences among groups in amount of exploratory behavior: the F ratio 
for groups is 0.22, a value that falls short of the .05 confidence level 
for 7 and 24 df. 

Third, are there any day-to-day changes in amount of exploratory 
behavior? The mean number of 12-in. sections explored during the 
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TABLE 2 


Mean Number of 12-Inch Sections Explored During the Ten Minutes 
of Maze Exposure on Day 1 


Grou p 
5 e a ee ee 
ubgroup I I Til IV Mean 
A 82.2 83.8 75.0 88.0 82.2 
B 89.2 82.0 84.0 79.5 83.7 
Mean 85.8 82.9 79.5 83.8 83.0 
TABLE 3 


Mean Per Cent Decrement in Amount of Exploratory Behavior in the Test 
Maze for Days 2 and 3 Combined 
eea aa çZ 


Group 
Sub a_l 
AEVONG I I Hl IV 
s a 
A -1 31 39 62 
B -3 24 36 59 
Mean -2 27 37 61 


a M e O 


first 5 min. of days 1, 2, and 3 for all 32 rats is 41, 44, and 41. Thus, 
amount of exploratory behavior is a stable phenomenon over maze 
luminance, groups, and period of experimentation. 

Fourth, is amount of exploratory behavior in the test maze @ 
function of the amount of time spent in the first maze (5 min. VS- 
10 min. )? Table 3 presents the mean per cent decrement in amount 
of exploratory behavior during the first 5 min, in the test maze as 
compared with the first 5 min. in the first maze for the various 
groups. The data for days 2 and 3 are combined. The A groups (10 
min. in first maze and 5 min. in the test maze) show a slight tendency 
toward a greater decrement than the B groups. However, the results 
of an analysis of variance show that this tendency is not significant 
(see below). 

The fifth question is the one posed by the experimental hypothe- 
sis: Is amount of exploratory behavior in the test maze a function 
of its difference in luminance from the first maze? Figure 2 sum- 
marizes the relevant data. It shows the mean number of 12-in. sec- 
tions explored by each of the four major groups plotted against 
minutes of exposure for the first maze and for the test maze. The 
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data for days 2 and 3 and for the subgroups within each major 
group are combined. In all cases only the first 5 min. of exposure to 
each maze is considered. Inspection of Figure 2 reveals (a) that no 
systematic differences among groups in amount of exploratory be- 
havior occur during exposure to the first maze, and (b) that sys- 


a I T 


TEST MAZE 


B W-W Be——_—e 


2LWG-GWe— - — -« 
B G-G Be—— ——o 
0|B B-wwe ------ as 


MEAN NUMBER OF 12 INCH SECTIONS EXPLORED 


0 1 2 3 4 5 
MINUTES 


Ficure 2. Mean number of 12-in. sections explored as a function of time of 
exposure to the first maze and to the test maze for each of the four major groups. 


tematic differences do occur in the test maze. The BW-WB group 
shows the greatest amount of recovery in exploratory behavior in 
the test maze, the WG-GW group the next greatest amount, the 
BG-GB group the next greatest amount, and the BB-WW group the 
least amount. A plot of per cent decrement in exploratory behavior 
in the test maze against differences in maze luminance in log units 
essentially a straight-line gradient. Thus, amount of explora- 
tory behavior in the test maze is a function of its similarity to the 
first maze. Reference to Table 3 substantiates this conclusion. 
Statistical analysis corroborates this and the preceding conclusion. 
The per cent decrement in amount of exploratory behavior in the 
(first 5 min.) as compared with the first maze (first 5 min. ) 


yields 


test maze 
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was computed for each rat. These scores were transformed into 


angles according to the formula, Angle = are sin \/percentage, and 
were subjected to an analysis of variance. The experimental design 
permits a two-way factorial analysis, the two components of which 
are time spent in the first maze (5 vs. 10 min.) and degree of change 
in maze luminance from the first to the test maze. The F ratio for 
maze luminance is 48.7, a value significant at well beyond the .001 
level for 3 and 24 df; the F’s for time spent in the first maze and for 
interaction are 0.65 and 0.21, values which fall short of the .05 level. 
The greater per cent recovery for the WG-GW group as compared 
with the BG-GB group is attributable to the fact that the physical 
difference in maze luminance is greater in the former case. 


Discussion 


The major finding confirms the experimental hypothesis: The 
decrement in exploratory behavior produced by exposure to one 
maze does generalize to other mazes, decreasing in amount as maze 
similarity decreases. This result is interpreted as providing additional 
direct support for the hypothesis of exploratory drive. That is, it 
further emphasizes the importance of external stimulation as a cone 
trolling factor in exploratory behavior. It also points to the operation 
of a stimulus generalization principle in exploratory behavior: When 
the strength of the exploratory drive evoked by a given stimulus 
situation is reduced, the strength of the exploratory drive evoked 
by other similar stimulus situations is also reduced, the amount of 
reduction decreasing as the similarity of the situations decreases- 

There are at least three other theoretical concepts that might be 
invoked to account for the present results. The first is Hull’s (1943) 
construct of reactive inhibition. According to Hull’s eighth postulate 
the performance of a response generates a certain amount of reactive 
inhibition—a negative drive—which mediates against the repetition 
of that response and which dissipates with time. This construct 
could account for the decrement in exploratory behavior produced 
by continuous exposure to a maze. However, because reactive in- 
hibition is stated to be specific to specific responses, and because 
the behavior in the first and test mazes involves highly similar if 
not identical respones, reactive inhibition provi 
plaining the differential amounts of recove 
havior in the test mazes. 

Hull’s (1943) concept of conditioned inhibit 
ing. Essentially, conditioned inhibition is a ha 


des no basis for ex- 
ty of exploratory be- 


ion is more promis- 
bit of resting, i.e., of 
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not responding, which is conditioned to external stimuli. Hence, it 
would transfer from one stimulus situation to another in accordance 
with the principle of stimulus generalization. Although conditioned 
inhibition could account for the generalization effects from one maze 
to another that occur on any one experimental day in the present 
study, it leads to the prediction that the decrement in exploratory 
behavior developed in a maze on any one day would transfer to the 
next day. Unfortunately for this explanation, exploratory behavior 
in this and other short-term studies (Montgomery, 1952b) shows 
relatively complete “spontaneous recovery” over a 24-hr, rest period. 

Sometimes exploratory behavior is explained by appealing to a 
“general activity drive” which supposedly is generated by internal 
organismic factors. There are at least two reasons why this concept 
is inadequate as an explanation of the present data. (a) It does not 
account for the rapid decrease in amount of exploratory behavior 
over short periods of time. In this and previous studies only one- 
fourth to one-third as much activity occurs during the fifth minute 
of maze exposure as during the first minute. (b) It provides no 
basis for predicting the differential amounts of recovery of explora- 
tory behavior produced by the variable of maze luminance. 

The fact that decrement in exploratory drive and its consequent 
exploratory behavior generalizes from one stimulus situation to 
other similar situations makes it possible to account for the gradual 


decline in exploratory behavior that occurs even in very large mazes. 
If a maze is relatively homogeneous, then the decrement in explora- 


tory drive produced by exposure to any given segment generalizes 
The result is a cumulative decrease in the 


to every other segment. Th a cl A ae: 
strength of exploratory drive. Thus, it is possible to explain the 
findings of Dennis and Sollenberger (1934) that rats run in large 
mazes comprised of homogeneous sections slow down in their activity 
and often stop exploring entirely. It should not be forgotten, how- 
ever, that extramaze stimuli play an important role in exploratory 
behavior, particularly when elevated mazes are employed. Evidence 


on this point will be presented in a later paper. 


SUMMARY AND CONCLUSIONS 

Thirty-two albino rats were run in mazes of three degrees of 
test the hypothesis that the decrement in exploratory 
duced by exposure to one stimulus situation generalizes 
Jar situations. On the basis of the experimental results 
ding discussion, the following conclusions are drawn: 


luminance t 
behavior pro 
to other simi 
and the prece 
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(a) The experimental hypothesis is substantiated: The decrement 
in exploratory behavior produced by exposure to one stimulus situ- 
ation generalizes to other situations, decreasing in magnitude as the 
similarity of the stimulus situations decreases. Hence, a principle 
analogous to stimulus generalization operates in exploratory be- 
havior. (b) Exploratory behavior, of the kind studied in this ex- 
periment, is greatly dependent upon stimulation external to = 
organism. This provides additional support for the hypothesis o! 
exploratory drive. (c) The concepts of “reactive inhibition,” oon- 
ditioned inhibition,” and “general activity drive” do not provide 
adequate bases for explaining the present results. 


[5] 

Stimulus Satiation: An Explanation of 
Spontaneous Alternation and 

Related Phenomena? 


MURRAY GLANZER 


In 1925 Tolman (1925a, p. 290) described a peculiar regularity 


in the behavior of rats that was later labeled spontaneous alterna- 
tion. 


A simple T maze was used, and it was arranged so that the animal 
could get back to the food box in identical fashion whether he chose the 
left or the right angle of the T. Either route met with success. . - - 
[There was] a very pronounced tendency toward continuous and regular 
alternation—left, right, left, right, or right, left, right, left... . It 
appeared, in short, that even where either side was equally “satisfactory 


* This paper is based upon a Ph.D. dissertation submitted in February 1952 
to the department of sychology at the University of Michi an, The writer is 
indebted to the members of the committee and to Dr. Edward L. Walker, 
chairman of the committee, who gave invaluable 


aid in the preparation and 
editing of this paper. 


source: Murray Glanzer, “Stimulus Satiation: An Explanation of Sponta- 
neous Alternation and Related Phenomena,” Psychological Review, 1953, 60, 
257-268. Reprinted by permission of the American Psychological Association 
and M. Glanzer. 
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there was in our rats a positive tendency left over toward variation of 
response . . . a positive tendency in and of itself. 


Ten years after Tolman’s report, spontaneous alternation received 
intensive study by Dennis and his coworkers. Although these early 
investigators did not incorporate their data into a formal theory, 
Dennis (1939) did imply that spontaneous alternation was in some 
way determined by the stimuli the subject faced. For example, the 
title of one article was “Spontaneous Alternation in Rats as an Indi- 
cator of the Persistence of Stimulus Effects,” and, in discussion of 
his results, he wrote about “a tendency to avoid a specific pathway 
which has recently been traversed” (1939, p. 310). This formulation 
suggests a theory of spontaneous alternation in terms of the stimulus. 
The rat alternates from one alley (a set of stimuli) to the other (a 
different set of stimuli), going to Alley B because it has already 
experienced Alley A. The theory proposed in this paper develops 


and systematizes this basic approach. i 
In direct antithesis to a stimulus-oriented theory is one which 


interprets spontaneous alternation in terms of the response. In a 
response theory, the animal is viewed as alternating responses in- 
stead of alleys, i.e., making a right turn because it has already made 
a left turn. Many of the more recent investigations examined below 


have stemmed from this theoretical position. 


NSE THEORIES 
lternation in terms of the response 
Hull-influenced investigators: 


A Critique oF RESPO 
Explanation of spontaneous 4 


has been attempted by several 
Heathers (1940) using the concept of performance decrement; and 


Solomon (1947) and Zeaman and House (1951) using the concept 
of reactive inhibition. According to both concepts, the occurrence 
of a response reduces temporarily the probability of its recurrence. 
The concepts were employed to explain both the fact of spontaneous 
alternation and the fact, predicted and demonstrated by Heathers 
(1940), that spontaneous alternation disappears as the interval be- 


tween trials increases. 


The concept of reactive inhibition, in addition, assigns an explicit 


role to the number of times the response is made and the amount of 
work required by the response. Thus, Zeaman and House (1951) 

redicted and found that giving animals forced trials to one of two 
alleys increased the tendency to alternate to the other; Solomon 
(1947) predicted and found some positive but not conclusive 
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evidence that increased work resulted in increased spontaneous 
alternation. 

Although these experiments seem to give considerable support to 
an explanation in terms of the response, a number of facts remain 
that resist explanation by this type of theory. Typical of these are 
the following: 

1. Dennis (1939) found that rats did not show spontaneous alter- 
nation from unit to unit of a multiple-unit maze. That is, they did 
not go right-left-right-left within a single trial on a four-unit maze, 
but showed instead spontaneous alternation in their successive 
choices at a given choice point. They might go right-right-right-left 

n the first trial and left-left-left-right on the second trial. This find- 
ing is in direct contradiction to the prediction which should follow 
from a theory in terms of the response. 

2. Jackson (1941) found that the difference between the two 
possible responses at the choice point did not affect the amount of 
Spontaneous alternation. A Y maze with a small angle of separation, 
requiring a choice between two practically identical responses, 
elicited as much Spontaneous alternation as a Y maze with a wide 
angle of separation. If the response were the key to spontaneous 
alternation, then differentiating the response should result in more 
alternation. 

3. Zeaman and House (1951), using a procedure of ten forced 
trials followed by a free trial, and Walker,” using simply two free 
trials, found that rats showed spontaneous alternation with intervals 
greater than an hour between trials. These findings disagree with 
expectations on the basis of reactive inhibition which is ordinarily 
assumed to dissipate within a few minutes. 

4. Wingfield (1943) found that human subjects showed more 
Spontaneous alternation in choice of lights that differed in color 
than of lights that were the same. Something in addition to con- 
sideration of the subject’s responses seems to be demanded by this 
finding. 

5. Dennis (1939) varied the amount of work for rats running @ 
maze by increasing the length of the final section from zero to 38 ft. 
but found no change in the amount of spontaneous alternation. It 
would seem reasonable to expect that the reactive inhibition from 

2 Walker, E. L. Unpublished data. 


? Reactive inhibition has to be assumed to disappear quickly in order that it 
meet its other theoretical commitments. (See Zeaman and House [1951].) 
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the added run of 38 ft. should dwarf the effects of reactive inhibition 
from the momentary act of turning right or left. 

These difficulties suggest that it might be fruitful to turn to the 
construction of an explanation in terms of the stimulus. As already 
pointed out, Dennis (1939) anticipated this type of explanation. 
Recently Montgomery (195la, 1952a, 1952b), on the basis of em- 
pirical findings of his own, has questioned the reactive-inhibition 
explanation of spontaneous alternation and proposes the concept 
of an exploratory tendency which is reduced by exposure to a path- 
way of the maze. Berlyne (1950) has presented a similar construct, 
a curiosity drive, designed to explain curiosity in rats. (Working 
toward a very different goal, that of incorporating perception and 
attention as “response” in Hullian theory, Berlyne (1951) has also 
sketched the outlines of a theory that displays some points of 
similarity to the formulation presented below.) 


A THEORY IN TERMS OF THE STIMULUS 

We shall assume that, with continued exposure to an environment 
Lto the same stimuli—the organism becomes less active in that en- 
vironment. With an eye to several experiments (Dennis, 1939; 
Heathers, 1940; Solomon, 1947; Zeaman & House, 1951), we assign 
a specific role to time in the disappearance of this boredom-like 
effect. Since, moreover, the explanation is in terms of the stimulus, 
it would be expected that “boredom” created in one situation would 
carry over to other similar environments and that the more similar 


two environments are, the greater the carryover. 
Using these ideas to form the construct of stimulus satiation, we 


shall follow Hull’s procedure (1943) and present the basis of the 
theory in the form of a postulate. 

This new postulate may not only enable us to circumvent the 
difficulties of the reactive-inhibition explanation but will also yield 
novel predictions. Furthermore, it may serve to interrelate and ex- 
plain empirical results from a number of apparently unrelated areas. 

The postulate reads as follows: 

Each moment an organism perceives a stimulus-object or stimulus- 
objects, A, there develops a quantity of stimulus satiation to A. 

i. The same amount of stimulus satiation develops in each successive 
moment. The total amount developed is, therefore, an increasing linear 
function of time. 


4 This term is suggested by Karsten’s work (1928). 
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ii. There is loss of part of each quantity of stimulus satiation in each 
successive moment. The amount of stimulus satiation remaining from 
each quantity is a decreasing negative exponential function of time. 

iii. Stimulus satiation developed to A will be generalized to other 
stimulus-objects B. The amount of generalized stimulus satiation is an 
inverse function of the discriminability of A and B. 

iv. The various quantities of stimulus satiation combine additively. 

v. Stimulus satiation reduces the organism’s tendency to make any 
response to A. 

Definition 1. Generalization, When a change in behavior toward A 
results in a similar change in behavior toward B, all other things being 
equal, generalization has taken place from A to B. 

Definition 2. Discriminability, The ease with which « subject can be 
induced to make a different response to A than to B, all other things 
being equal, is called the discriminability of A and B. 


Two corollaries follow from the postulate: 


Corollary I. As long as an organism remains perceiving A, the amount 
of stimulus satiation it has to A at a given moment (that is, the total 
amount developed [i] minus the total amount lost [ii]), is an increasing 
negative exponential function of time. 


exponential function of time. 


These corollaries are presented in 
values assigned to the functions, 
Given the characteristics of various situations, the postulate yields 
a large number of deductions, A number of these for some basic 
types of situations are formulated and discussed below. For each 
deduction discussed, we will indicate whether or not it is crucial for 
the two theories, e.g., one in terms of the stimulus as against one in 


terms of the response, as well as state the nature of any existing 
evidence. 


Table 1 and Figure 1 with arbitrary 


DEDUCTIONS FOR APPROACH RESPONSES egr 
Two-ALTERNATIVE SITUATION 


Spontaneous Alternation 


Let us start with a very simple situation, This situation is one in 
which S has evenly spaced, consecutive trials in ati apparait diet 
contains two distinct areas, such as a single-unit T Smee a 
trial starts with S’s entrance into the apparatus and ends with its 
exit from the apparatus. 
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STIMULUS PRESENT STIMULUS ABSENT 


TIME 


satiation, 2In, as a function of time 


Ficure 1. Total amount of stimulus 
lus-object. The totals of the columns 


and the presence or absence of the stimu 
of Table 1 are represented by this figure. 


TABLE 1 


Corollaries I and II Illustrated by Obtaining Values for Stimulus 
Satiation, I, = 100 e~("—) (Where n is the Number of Moments since 


the Appearance of the Stimulus) ° 


Stimulus Moments 
Satiation Stimulus Present Stimulus Absent 
Quantity 
1 2 3 4 5 6 7 8 
i 100.0 36.8 13.5 5.0 18 q 3 ali 
I: 100.0 36.8 13.5 5.0 1.8 A 3 
Is 100.0 36.8 13.5 5.0 1.8 i 
L 100.0 36.8 13.5 50 18 
ZIn 100.0 136.8 150.3 155.3 57.1 210 78 29 


imulus satiation as it decreases 


° Each row gives the history of a single quantity of st i 
ulus satiation present during a 


with time. Each column gives the total amounts of stim 
single moment. 


In order to complete a trial S has to enter one of the two areas or 
alleys. These areas should be initially more or less equally attractive 
to S. During the course of the experiment, furthermore, one area 
should not be made more or less attractive than the other by intro- 
ducing reward or punishment. A situation that has these characteris- 
tics will be called a simple two-alternative situation. 
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The alternatives correspond to stimulus-objects A and B of the 
postulate. The S approaches and perceives one of the two on each 
trial. It will be assumed that S, upon entering an alternative, “per- 
ceives” it. 

The S, perceiving one alternative, builds up stimulus satiation 
to it that reduces the tendency to respond to that alternative. The 
response considered here is the response of approach, since E usually 
records and requires only that response for completion of a trial. 


Deduction 1. In the simple two-alternative situation, the subject will 
alternate choice of arms or alleys in successive trials. 
Verified; not crucial. 


This is the simple fact of spontaneous alternation which has been 
repeatedly demonstrated (Dennis, 1935, 1939; Heathers, 1940; Jack- 


son, 1941; Solomon, 1947; Tolman, 1925a; Wingfield & Dennis, 1934; 
Zeaman & House, 1951), 


Deduction 2. In the simple two-alternative situ 
exchange between trials of stimulus 
one side of the S now are on the 
approach to stimulus-objects in su 
tion of responses rather than an a 

Verified; crucial. 


ation, if there is an 
-objects so that the cues that were on 
other, and vice versa, S will alternate 
cessive trials. This will mean a repeti- 
Iternation of responses (turns). 


ernation of response, whereas a 


theory in terms of the response predicts no decrease. 


The author (Glanzer, 1953b ) 
with two starting boxes (north a 
the Ss to start from one startin 


sponses as required by the reactive-; 
as required by the stimulus satia 

Twenty-six rats were given t 
day for eight days. On four of 
same starting box; on the other 
posite starting boxes. As predicted above, the 
repeat (i.e, go right-right or left- 
responses on the days that the 


tion explanation, 
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clearly that they were alternating alleys (stimuli) rather than turns 
(responses), A similar experiment has been described by Mont- 
gomery (1952a) who reports results consistent with these findings. 


Deduction 3. In the simple two-alternative situation if an extended 
series of consecutive trials is given, the tendency toward spontaneous 
alternation will be at a maximum for the first pair of trials, and will 
decrease to a minimum in later trials. This decrease will be called cumu- 
lation-effect. 

Tested but not clearly verified; not crucial. 


In a series of consecutive trials in a two-alternative situation, if 
the first trial was to alternative A, then the second trial would be 
to alternative B (Deduction 1). There would be two stimulus satia- 
tion curves then: one for alternative A starting from the first trial, 
and continuing its rise through later trials to alternative A; the other 
for alternative B, starting from the second trial. Since, according to 
Corollary I, curves of stimulus satiation are negatively accelerated, 
the two curves would approach each other in the later trials. The 
difference in amount of stimulus satiation to the two alternatives 
would therefore decrease as illustrated in Figure 2, leading to the 
predicted decrease in spontaneous alternation. 


Zin 


END OF TRIAL: 1 2 3 4 5 6 

Ficure 2. Total amount of stimulus satiation, In, to two alternatives, A 
and B, in successive alternating trials. The curves, approaching their limits, 
cause a decrease in the difference (the distance between the curves) in the 
amount of stimulus satiation to the two alternatives. All odd-numbered trials 
are to A, even-numbered to B. Decreases occurring during intertrial intervals 
have not been drawn. 
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Although results from Wingfield and Dennis (1934), Heathers 
(1940) and the author (Glanzer, 1952) show the general trend 
toward decrease in spontaneous alternation from first to last trial 
in a series, the data also show reversals and considerable irregularity. 

The inconclusive nature of these data may result from the very 
procedure indicated by Deduction 3, In this procedure the animal 
is free to choose either alternative each trial in the series. The E 
therefore soon loses control of the basic variable, the number and 
order of particular choices that precede a given trial. 

In order to make an adequate test of the prediction, it may be 
necessary either to use a group of animals large enough to cancel 
individual differences in the pattern of choices or to change the 
procedure in order to control the pattern of choices throughout. 
Clearer results would be expected, then, for the following deduction. 


Deduction 4. In the simple two-alternative situation, if a number of 
forced consecutive alternation trials is given, as the number of trials in- 


creases, the tendency toward Spontaneous alternation decreases. 
Not tested; not crucial, 


w we turn to considerati 


No on of the role of generalization, On 
the basis of part iii of the pos 


tulate, the prediction could be made 
e alternatives, the greater the amount 
scriminability can be varied by several 


or add cues that differentiate the two 
alternatives. 


Deduction 5. In the si 
entiating the alternative. 
decrease. 

Tested but not verified; crucial. 


mple two-alternative situation, as stimuli differ- 
S are eliminated, spontaneous alternation will 
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discriminate, two may be singled out on the basis of empirical 
studies. One is sense-organ damage and the other is brain-injury 
(Lashley, 1930). If these conditions may be considered to reduce 
discriminability, then the following more specific deductions may 
be made.5 


Deduction 6a. In the simple two-alternative situation, the greater the 
extent of S’s sense-organ damage, the less the amount of spontaneous 
alternation. 


Not tested; crucial. 
Deduction 6b. In the simple two-alternative situation, the greater the 


extent of S’s brain damage, the less the amount of spontaneous alterna- 
tion, 
Verified; crucial. 


Certain of Krechevsky’s (1937a 1937b) results support this de- 
duction. He found that brain-operated rats perseverated in choice 
of one of two paths much more than did normal rats. His situation 
described below was somewhat complicated but the basic two- 


alternative arrangement was employed. 
Now we turn to the effects of time on spontaneous alternation. 


o-alternative situation, as the interval 


Deduction 7. In the simple tw 
f spontaneous alternation decreases. 


between trials increases, the amount o. 
Verified; not crucial. 


This deduction follows simply from part ii of the postulate. It 
has been verified by Heathers (1940) who found that, as the time 
interval between trials increased from 15 sec. to 15 min., spontaneous 
alternation decreased from 86 to 50 per cent ( chance). It is also 
verified by Zeaman and House (1951), who found a decrease over 


a period of 24 hr. 


Deduction 8. In the simple two-alternative situation, the more highly 
differentiated the alternatives, the longer the time interval between trials 
necessary for the disappearance of spontaneous alternation. 

Not tested; crucial. 


This may, in part, explain the widely discrepant data that have 
been obtained concerning the effects of delay on spontaneous al- 
ternation. For example, Walker,® using a highly differentiated Y 

5 Strictly speaking, Deductions 6a, 6b, 15 hold only for situations in which 
there is empirical support for the stated relationship between brain or receptor 
injury and discriminability. 

8 See footnote 2. 
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maze, found spontaneous alternation with intervals longer than an 
hour. Montgomery (195la), who took special care to keep his 
alternatives alike, found that spontaneous alternation disappeared 
with intervals as short as 90 sec, 

Now we turn to an implication of Corollary I, that the longer 
the time the organism perceives a stimulus-object A, the greater the 
amount of stimulus satiation to A. 


Deduction 9. In the simple two-alternative situation, if S is detained in 
one alternative, the amount of spontaneous alternation to the other alter- 


native on the following trial will be greater, the longer the time of 
detention, 


Not tested; crucial, 


interval spent within the alternative, These distinctions can be kept 


clear in the formulation of a new deduction in terms of the interval 
between choices, 


Deduction 9a. In the simple two-altern, 
interval between choices constant 
between choices spent 


ative situation, with the time 
i » the greater the proportion of time 
in the presence of the chosen alternative, 
alternation on the succeeding 


Deduction 10. In the simple two-alternative situation, if S is delayed 
between choices and this delay occurs within the alternative last chosen, 
S will show more spontaneous alternation than under a condition of no 
delay. If, however, § is delayed between choices and this delay occurs 
outside the alternative last chosen, S will show less spontaneous alterna- 
tion than under a condition of no delay, 

Verified; crucial, 
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Deduction 11. In the simple two-alternative situation, if S is given 
forced runs to one alternative, the greater the number of such forced 
trials, the greater the amount of spontaneous alternation on a subsequent 
free-choice trial. 

Verified; not crucial. 


This procedure is basically the same as that involved in Deduction 
9. In Deduction 11 the animal builds up stimulus satiation during 
repeated visits to one alternative; in Deduction 9 it does so during 
a period of detention within the alternative. Zeaman and House, 
deriving their hypothesis from the reactive-inhibition postulate, veri- 
fied Deduction 11. 

The amount of spontaneous alternation obtained by each of the 
two procedures, by forced trials and by detention at the alternative, 
may now be compared to yield a clearly critical deduction. 


Deduction 12. In the simple two-alternative situation, detention of S 
for a given period of time at the alternative last chosen will yield Jarger 
amounts of spontaneous alternation than will a series of forced trials to 


one alternative over the same period of time. 
Not tested; crucial. 


In the forced-trial procedure, as compared with the detention 
procedure, S, being taken from end box to starting box, spends a 
smaller proportion of the time within the alternative itself. Thus S 


has less time to develop stimulus satiation. 


Variability (Preference for Variable Situations ) 


An important variation of the two-alternative situation is one in 


which the cues of one alternative are varied while the cues of the 
other are kept constant. This type of situation has been investigated 
in two studies of “variability.” Krechevsky (1937, 1937b) used a 
two-alternative maze, both arms of which contained a number of 
turns, One arm could be varied in pattern of turns from trial to trial. 
Both variable and constant arms were constructed so that there 
was an equal number of right and left turns within each arm. 

Three different maze arrangements were used: a long varying 
versus a short constant path (Krechevsky, 1937a); a short varying 
versus a long constant path (Krechevsky, 1937b); a long constant 
versus a short constant path (Krechevsky, 1937b ). In each of these 
Krechevsky ran two groups of rats, one group normal and the other 
brain-operated. 

In such a situation, stimulus satiation to the varying alternative 
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will be reduced by its division among the different forms of the 
varying alternative. Essentially, a situation exists in which the con- 
stant alternative A is opposed by a family of alternatives B}, Bo, Bs, 
- . » Ba. Alternative A bears the weight of all of the stimulus satia- 
tion built up during an exposure to it; the family of alternatives B 
divides stimulus satiation among its variations. 


Corollary III. If an alternative is varied from trial to trial, then less 
stimulus satiation will be built up to it than if no such variation occurs. 
Deduction 13. In the simple two-alternative situation, if one of the 


alternatives is varied from trial to trial and the other is kept constant, then 
S will prefer the varied alternative, 
Verified; crucial, 


ence is strong enough to 
when it is the longer path,” 


Corollary IV. If an alternative is varied from trial to trial, the more 


discriminable the variations the less the amount of stimulus satiation that 
will be present for the alternative, 


distinguishing cues of the perceived 
objects and impairment of the Sensory or nervous systems of the Ss. 


Consideration of these methods leads to the following deductions. 


Deduction 14. In the simple two-alternative situation, the preference 
for a varying alternative (as opposed to a constant alternative) will be 
greater, the greater the difference between variations. 

Not tested; crucial, 

Deduction 15. In the simple two-alternative situation, brain-injured Ss 
will show less preference for a varying alternative (as opposed to a 
constant alternative) than will normal ‘Ss. 

Verified; crucial. 


7 Krechevsky’s findings cannot be explained in terms of reactive inhibition 
or any other theory in terms of the response since, as pointed out earlier, the 
mazes were designed so that I ha ST lowinn Sme number of right and left 
turns within it. The Ss would ae : owing each trial, an equal amount of 
reactive inhibition to right and left turning. 
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In Krechevsky’s studies (1937a, 1937b) the normal animals pre- 
ferred the varying alternative more strongly than did the operated 
animals. 

Finally, it can be deduced that the greater the number of varia- 
tions that share the stimulus satiation, the less the amount present 
to each, 


Deduction 16. In the simple two-altemative situation, the greater the 
number of variations, the greater the preference for the varying alter- 
native, 

Not tested; crucial. 


DEDUCTIONS FoR THE MULTIPLE- 
ALTERNATIVE SITUATION 

We may now generalize the deductions to apply to situations with 
more than two alternatives. For example, let us apply the postulate 
to the behavior of S in the three-alternative situation. The S, after 
choosing one alternative, will build up stimulus satiation to it. 
Upon returning to the choice point for a second trial, S will probably 
choose a new alternative since responsiveness to the first choice has 
been reduced. If returned again to the choice point, S will probably 


choose the “unsatiated” third alternative. 
Deduction 1’. In a simple multiple-alternative situation, S will choose 
many alternatives in a series of consecutive trials. 
Definition 3, Many alternatives mean more altern 
sonably be expected on the basis of chance. 


atives than could rea- 


Deduction 1’ is verified by the findings of Wingfield and Dennis 
(1934) on the number of different paths chosen by rats running 
four trials on a four-alternative maze. 

Deduction 1 appears as simply a special case of Deduction 1’, In 


fact, a set of more general deductions can now be obtained in most 


cases merely by changing “two-alternative” to “rhultiple-alternative” 
and “spontaneous alternation” to “tendency to choose many alterna- 
tives.” Each of the 16 earlier deductions becomes a special case of 
one of the new set of 16 deductions for multiple-alternative situa- 
tions. 

Consideration of situations involving more than two alternatives 
suggests a new variable, the number of alternatives, which can form 
the basis of several new deductions. One such deduction, of partic- 
ular interest, concerns the cumulation effect of Deductions 3 and 5 
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and its counterpart in multiple-alternative situations, i.e., the is 
crease in the tendency to choose many alternatives in an extende 
series of trials. 


Deduction 17’. If there are two simple multiple-alternative me 
and one of them has a greater number of alternatives than the other, t ie 
the cumulation effect will be smaller and will develop more slowly fo’ 
the situation with a greater number of alternatives, 


Cumulation effect depends on the summation of amounts of 
stimulus satiation from successive visits to the same alternative. In 


like spontaneous alternation, becomes a 5 
the postulate. The word choice re 
ductions, since we are no longer ¢ 
earlier; and the procedure is no longer called “simple.” 

® The relationship between spontaneous alternation d me 
was pointed out by Tolman (1925a) who explained the f exploratory behavio' 


i e 
latter. We, however, view both spontaneous ormer in tems of oe 
havior as manifestations of a single underlying nd exploratory 


Places the word trial in the de- 


altemation 
factor 
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Most of the deductions have not been tested in the “free” pro- 
cedure. Those for which there are relevant data have been verified. 
For example, there is the following deduction involving cumulation 
effect. 

Deduction 3”. In the multiple-alternative situation, if an extended 
Series of consecutive choices is given, as the number of such choices 
increases, the tendency to choose many alternatives decreases. 


This has been verified by Dennis and Sollenberger (1934) and 
later by Montgomery (1952b). Both studies found that rats enter 
fewer and fewer alleys in successive periods of free exploration. 

Another deduction for which there are data is the following: 


Deduction 17”, If there are two multiple-alternative situations and one 
of them has a greater number of alternatives than the other, then the 
cumulation effect will be smaller and develop more slowly for the situa- 


tion with a greater number of alternatives. 


This has also been verified by Dennis and Sollenberger (1934) 
and Montgomery (1952b). They found that larger mazes elicited 
more activity and continued to elicit activity over a longer period 
of time than did small mazes. Larger mazes are considered here to 
contain a greater number of alternatives. 


POSSIBLE APPLICATIONS OF THE THEORY 
TO HuMAN SUBJECTS 

Although most of the work in t 
been carried out with rats as Ss, 
from human Ss that is congruent wi 

The closest analogue to the two-alternative situation that elicits 
spontaneous alternation in rats is found in a study by Wingfield 
(1943) who required college students to turn on one of a pair of 
lights. In a series of four trials the Ss not only spontaneously alter- 
nated the lights they chose to turn on (Deduction 1) but also 
showed more spontaneous alternation on the first pair than on the 
second pair of trials (Deduction 3) and more with lights of different 
hue than with lights of the same hue (Deduction 5). 

Karsten’s (1928) work on the phenomenon which she calls “satia- 
tion” (Sättigung) is of particular interest. She had her Ss perform 
repeatedly such tasks as drawing lines or tapping.® This activity 


° Berlyne (1951) handles these data in the same wa in his expansion of 
Hull’s theory to include perceptual “responses.” 4 s 3 


he areas under consideration has 
there is some evidence obtained 


th the postulate. 
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produces repeated experience of certain stimulus-objects, e.g., lines 
drawn, and can therefore be considered a case covered by Deduc- 
tion 13”. This deduction can be considered to predict Karsten’s 
finding of the Ss’ resistance to continuing the task as well as their 
variations from the prescribed activity." The phenomenon of cosa- 
tiation (transfer of satiation symptoms to new and similar tasks) 
could also be predicted from part iii of the postulate. 

A further finding by Karsten suggests the relevance of the postu- 
late to the problem of fatigue. Symptoms of satiation, including the 
Ss’ inability to move their arms, disappeared when the grouping 
of the lines being drawn was changed even though the required 
muscle movements remained the same. This recalls two things: 
part iii of the postulate and the recent emphasis on factors other 


than simple muscle states in understanding the phenomenon of 
fatigue (Bartley, 1951 J 


[6] 
Response by the Rat to Environmental 
Change 


WILLIAM N. DEMBER 


~ source: William N. Dember, “Response by the Rat to Envi a$ 
iv Physi i hange, 

urnal of Comparative and Physiological’ p. Pvironmental Chang 
bis by permission of the pE T sychology, 1956, 49, 93-95. Re- 


Dember. can Psychological Association and W. N. 
e: g 
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An immediate implication of Glanzer’s theory was tested by 
Walker, Dember, Earl, Fliege, and Karoly (1955). In one experi- 
ment, rats were placed in either a black or a white compartment for 
periods ranging from 30 sec. to 30 min. This exposure had no effect 
on the rat’s choices when they were subsequently put in a T maze 
with one black and one white arm. In a second experiment, the 
exposure took place in either of the two goal boxes of the T maze. 
Again, this experience had no effect on the rats’ behavior in an 
immediately following choice in the same apparatus. 

Kivy, Earl, and Walker (1956) argued that while mere exposure 
per se was ineffective, it should be possible to produce “alternation” 
if the exposure were made in the context of the choice point. This 
hypothesis was tested and confirmed. Rats were introduced into 
the starting alley of a T maze, with the goal alleys blocked off at 
the choice point by means of two glass partitions. The rats could 


see into, but not enter, the goal arms. Exposure periods of 1, 15, and 


30 min. were used. During this time the two arms were either both 
black or both white. For the test trial the glass partitions were re- 
moved and the color of one of the arms was changed, thus present- 
ing the animal with a choice between a black and a white alley. 
For the 15- and 30-min, exposures the results were as predicted. 

These data may be looked on as supporting a version of the 
satiation concept in which the relevance of context is emphasized. 
An alternative hypothesis is possible, however. Consider the rat 
that sees on its first exposure a black arm on the left and a black arm 
on the right. On the second trial the left arm is still black, but the 
right arm has been changed to white—a change certainly worth 
exploring. In the language of Berlyne (1950) and Thompson and 
Solomon (1954) the changed arm might represent “novelty” and 
would therefore invoke the “curiosity motive.” Behaviorally, the 
animal would enter the changed arm. 

In the Kivy, Earl, and Walker experiment the satiation and the 
novelty hypotheses are equally applicable. It is the purpose of 
this paper to describe an experiment for which only the latter 
hypothesis seems appropriate. 

In the present experiment the stimu 
trials of the Kivy, Earl, and Walker experiment are reversed. That 
is, on trial 1 the rat is presented with, but cannot enter, one white 
and one black arm. On trial 2, one of the arms is changed so that 
the rat now encounters two alleys, either both black or both 
white. On the basis of the novelty hypothesis it is predicted that 


lus configurations in the two 
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the rat will enter the arm which has been changed. A simple 
satiation theory can make no prediction about the choice on the 
second trial, since the animal is equally “satiated” for both alterna- 
tives. 


METHOD 


Animals 


Two groups of animals were used. Group I was composed of 12 male 
albino rats, approximately 180 days old, obtained from the Maguran 
Farms colony. About 90 days previous to the present experiment these 
rats had served in an alternation experiment involving neither reward 
nor punishment, and in which a different procedure, apparatus, experi- 
menter, and experimental room were used. It is assumed that for the 
purpose of the present experiment the animals were naive, The rats were 
handled for several days prior to the experiment, and for two days were 
run hungry to food along a board between two chairs. 

Group II consisted of 8 male albinos of the Maguran Farms strain, 
approximately 100 days old; these animals were experimentally naive. 
Their two days of pretraining involved placing them hungry on a large 
table on which food pellets had been scattered, They were allowed to 
explore and eat freely for about 30 min. each day, 


During the experiment itself animals of both groups were satiated for 
food and water. 


Apparatus 


The T maze which was used has been described by Ki Earl, and 
Walker ( 1956). Its only special characteristics were the reg re parti- 
tions which could be inserted at the choice-point, and the fact that the 
color of each arm could be easily changed. 


Procedure 


As in the Kivy, Earl, and Walker ex 
were called for. On trial 1 the two ar, 


m individually in a tin 
Prior to its entry. The 
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RESULTS AND DISCUSSION 


Ten of the 12 Group I rats made the pr 
of the 8 rats in Group II. By the sign tes 
are significant at the .001 level of confidence. 
_ The amount of actual “exposure” at the choice point is of some 
interest; these data are available for the animals of Group IJ, which 
spent an average of 3.45 min. with their heads in the area of the 
choice point. The one rat in this group that did not make the 
predicted response also had the briefest exposure, 117 sec. 

These results support the hypothesis that exploration of novel 
stimulation, in the form of a change in the color of one maze arm, 
rather than simple stimulus-satiation, is the appropriate explanation 
of the Kivy, Earl, and Walker data, To explain the results of the 
typical alternation experiment, it would be necessary only to assume 
the maze arm last entered is, for some period afterward, the less 
novel, 

Proponents of satiation theory might 
only for a stimulus-in-a-place. Thus, an animal is satiated for black- 
On-the-left, not simply for black. With this assumption added to 
satiation theory, it is then possible to account for the present re- 
sults, It should be pointed out, however, that such an assumption 
is incompatible with the logic of the original stimulus-satiation ex- 
periments (Glanzer, 1953a; Montgomery, 1952a; Walker, et al., 
1955), wherein stimulus and place must be assumed to be independ- 
ent. 


edicted choice, as did 7 
t, the combined results 


argue that satiation occurs 
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Evidence for Learning Motivated by 
“Exploration” ' 


ARLO K. MYERS and NEAL E. MILLER 


(Editors note: In its 


ments. The first attempted to demonstrate 
learned drive based 


that is, they were started in the w 
touch the intervening door, to open it, 
ment containing the food. Then, in 
when the four groups of rats were satiated with food and not rewarde 
for running, they were required to learn a new response of pressing @ 
bar in order to gain entry into the black compartment, All of the groups 
learned this new r able differences were obtainec 
among them as a result of their different amounts of prior drive-acquisi- 
tion training. Thus, although the first experiment did not provide any 
i unger and food reward, it di 
rm a response even when they 
ndition of reinforcement, such as 


> P A t 
a subsequent drive-acquisition test, 


were without any app 
hunger and food.) 


EXPERIMENT II 


1 This investigation Was supported b a . the 
National Institute of Mental Health, of th Neesearch grant, M647, from 
Health Service. The main findings were 


r ar of 
the Eastern Psychological Association at New York. at the April 1954 meeting 


source: Arlo K. Myers and Neal E. 
Based on Hunger; Evidence for 


3 ; eamin; Motivated by ‘Ex oration,’ ” Journa: 
of Comparative and Physiological Psy chol ‘Ploration, m 
o P EAE Pahoa SEY, 1954, 47, 428-436. Reprinte 


Association and A. K. Myers and N. E. 
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ance), the first group was run from white to black while the second 
one was run in the opposite direction. This symmetrical type of a 
control for obvious, or even latent, preference is believed to be a 
particularly important one for experiments purporting to demon- 
strate learning from a motivation such as exploratory behavior, 
curiosity, or activity drive. To determine whether the sight and 
sound of the door dropping is sufficient to produce learning or 
whether entering and inspecting the black compartment is neces- 
sary, a third group was run from the white compartment but with a 
white panel fastened securely in place just behind the door. To 
determine whether spaced practice was necessary, a fourth group 
was run with massed trials. So that the massing would be comparable 
to that used in Miller’s (1947, 1948) experiments on fear, it was 
necessary to eliminate the 16 min. in the activity box and 8 min. 
in the detention cage. In order to control for these changes in pro- 
cedure, a fifth group was run with spaced trials, but with the periods 
in the activity box and detention cage omitted. 


Method 
Susyects. The Ss were 50 naive male albino rats of the Sprague- 


Dawley strain, approximately 70 days old at the start of the experiment. 
All animals were maintained in individual cages on an ad lib. diet of 


water and Purina Laboratory Checkers. p x y 

Apparatus. The apparatus was identical with that used in Experi- 
ment I except for minor changes. For the animals running from the black 
compartment, pressure on its floor started the timer; touching a bar lo- 
cated in the same relative position as the one in the white compartment 
dropped the door and stopped the timer. In other words, the operations 
of running from white to black or black to white were similar. 

Procepure, The animals were tamed by being handled once a day 
for five days when satiated without receiving any food reward. The first 
phase of Experiment I, hungry-reward training in the apparatus, was 
omitted, The animals were on ad lib. feeding throughout the experiment, 
and were fed wet mash for 48 min. before each training trial. Immedi- 
ately after taming, the animals were divided into five groups of ten each, 
approximately equated for mean body weight, and randomly assigned to 
the following five experimental conditions: é 

1. A white-to-black group with a procedure duplicating that used in the 
second phase of the first experiment. 

2. A black-to-white group run in exa! 
site direction. This was the only group 

3. A white panel group run exactly like the first group except that 
when the door dropped, the animals were prevented from seeing or 
entering the black compartment by a white wooden panel immediately 
behind the door. To equate the effect of the time interval between bar 


ctly the same way but in the oppo- 
started in the black compartment. 
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pressing and being picked up and placed in the detention cage, each 
member of this group was given a partner in the white-to-black group 
and was removed from the apparatus at the moment which would make 
S’s interval on that trial equal to that of its just-previously-run partner. 

4. The massed group received all 18 of their trials in a single afternoon 
with an intertrial interval averaging approximately 3 min. The ten ani- 
mals in this group were randomly subdivided into three, four, and three 
animals, respectively, which were run on the first, middle, and last days 
of the experiment. To achieve the close massing, the activity box and 
detention cage were omitted from the procedure; the animals were re- 
turned immediately to their home cages (from which food and water 
had been temporarily removed) after each trial. In other respects, the 
procedure for the massed group was the same as that for the white-to- 
black group. 

5. The massed control group was run without the activity box or deten- 
tion cage to determine the effect of omitting these procedures. They 
were run exactly like the massed group except that their trials were 
distributed at the rate of one per day like those of the first three groups. 


Results 


All the latency scores were transfor 


med into speed scores as 
described for Experiment I. The results 


are presented in Figure 1. 


70 


Black-to-White Group 


60 


50 


White-to-Black Group a 
IN 


Massed Control Group 


SPEED OF RESPONSE 


9 12 
TRIALS WITHOUT HUNGER OR FOOD 
Fıcure l. Effect of experimental condition: 


i i tes learning of the bar-pressing 
e by groups trained without hun . p 
i = 160/time in sec. ger drive or food teward. Speed of 


15 18 
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bs five groups start out at roughly the same level of performance; 
al the white panel and massed groups show little change 
roughout the 18 trials, the others show definite learning. 
3 pe animal’s scores were summed for the first six, middle six, 
ms last six trials, and the resulting matrix of 150 scores for the 50 
ia was subjected to analysis of variance to assess the over-all 
il ch, due to blocks of trials, groups, and groups X trials interaction. 
i, hree produced highly significant F's, with p in each case less 
an .01. Table 1 summarizes this analysis. 

Then, for the mean of all 18 trials, separate ¢ tests were com- 
puted comparing each group with every other one. Of these ten 
romparjsons, all but two produced differences significant at the .01 
evel of confidence or beyond. The difference between the white- 
to-black and massed control groups and between the massed and 
white panel groups were not significant (p = -79 and .59, respec- 
tively), 

Next, the significance of the trend for each group was analyzed 
by computing separate t tests among the three blocks of six trials. 
None of the comparisons among blocks of trials even approached 
significance for either the massed or white panel groups. The other 
three groups all showed an increase from the first to the third block 
of trials significant beyond the 01 level of confidence. These three 
groups also showed significant increases from the first to the second 
block, and from the second to the third block, with the exception 
of the black-to-white group, which showed a significant decrement 


from the second to the third block of trials. 


TABLE 1 
Analysis of Variance of Speed Scores in Experiment II 
Source of Variance Mean Square df F p 
1. Groups 2,716,275° 4 13.86 <.01 
2. Trials 865,061 2 71.48 <.01 
3. Trials x Groups 221,908 8 18.34 <.01 
4, Rats within groups 196,031 45 
5. Rats within groups X Trials 12,102 90 


© Tested against 4. 
} Tested against 5. 


Since all groups started from nearly the same level of perform- 
ance, the foregoing analysis gives a fairly complete picture of the 
differences among the five groups. As a further check, separate t 
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tests were computed on the differences between trends among 
five groups. An examination of the resulting 30 comparisons simp 7 
confirms the impression one gets from an examination of Figure 1. 


any stage of training. 

After pressing the bar, all the animals (except those prevented by 
the white panel) at least poked their heads into the other compart- 
ment and sniffed around. More of the animals going to the white 
entered all the way than of those going to the black. On the first 


-to-white group and each of 
the others was significant beyond the ,01 level. 

For the first 18 trials during which a direct comparison is possible, 
is li nce between the learning by the white- 
to-black group in Experiment II and by the 70-trial group (white- 
to-black) in Experiment J, Though the rats that had had 70 
i isiti y show some slight superi- 
se their fear of the door’s 
> the mean speed for these animals 


significantly greater than that for 
ment II (p = .38) 


ority in early trials ( presumably becau 
dropping has been extinguished ) 
averaged over all 18 trials is not 
the white-to-black group of Experi 


Discussion 


were prevented from seei 
not learn. (c) Animals trained with m 


activity box and de- 


: running procedure because the massed 
control group, which was given Spaced trials with 


omitted, learned as well as the white-to-black gro 
The fact that the black-to-white 
white-to-black group suggests that a 
partment may be a source of Some motivation and reward in the 
apparatus. However, the fact that both groups (running in opposite 
directions) learned shows that such a preference is not a necessary 
condition for learning, Apparently the fact that Pressing the bar is 
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followed by the chance to observe and enter a new compartment is 
sufficient to produce learning. 
The fact that the white panel group did not learn shows that the 
cues produced by bar pressing and door dropping, or by being 
picked up and returned to the home cage via the detention cage, 
are not sufficient to produce learning; it suggests that the act of 
seeing or exploring the other compartment, or perhaps experiencing 
the change between the two compartments (irrespective of the 
direction of change), produces the reinforcement. But we cannot 
tell whether or not exposure to the new stimuli in the other compart- 
ment would produce learning even if the animals were prevented 
from entering or exploring. 
Since dropping the door provided the animals with more space in 
which to move about, it might be argued that the reinforcement 
came from this greater opportunity to exercise or escape restriction. 
However, the white-to-black group did not seem to perform any 
worse than the massed control] group which was run under identical 
conditions except for the omission of the activity box and detention 
cage, Presumably exercise in the activity box before each trial, as 
opposed to confinement in the small home cage, would have reduced 
the exercise drive and produced poorer performance in the white- 
to-black group. The fact that the massed controls were returned 
directly to their home cage, rather than to a detention cage, after 
each trial might also be expected to produce superior learning if 
return to the home cage were a significant part of the reinforcement. 
Thus, the lack of any appreciable difference between these two 
groups also serves as additional evidence against assigning an im- 
portant role in these particular experiments to reinforcement from 


return to the home cage. 

Guthrie’s (1952) principles might be used to explain the learning 
shown by groups that had a chance to enter the other compartment 
and were run with distributed practice. Pressing the bar would be 
the last thing that the animal did before entering the other compart- 
ment, where the change in cues would protect S from unlearning 
the habit of pressing the bar by removing the opportunity to per- 
form different responses to the original cues. But this explanation— 
at least in its simplest, most obvious form—would seem to apply 
equally well to the massed group which did not learn. If it is assumed 
that general changes in posture and other sources of interoceptive 
stimulation are more likely to occur during the longer interval, the 
task of the animals with distributed practice would be more difficult, 
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since they would have to attach the response of pressing the bar to 
a greater variety of combinations of cues, Thus it seems that a simple 
form of Guthrie-type explanation is not able to account for the 


difference between the learning of the groups with massed and 
distributed practice. 


The failure of the massed group to learn confirms the conclusion 
from Miller's (1947, 1948, 1951) previous studies that learning will 
not occur during massed trials in his apparatus unless specific 


procedures have been used to establish a learned drive, such as 
fear. 


» i.e., the ones explored, both elicit the drive 


We, however, would not put a drive in a special category simply 

? According to observations by Sharpless (1954a), imuli elicit an 
“arousal reaction” presumably involvi g the Danten stm beeen 
This “arousal reaction, indicated by œ aracteristic ¢ anges in brain waves, 
shows fairly rapid extinction ( Presumably as the stimulus loses its novelty) and 
eventual recovery analogous to that described above, It is conceivable that this 
arousal reaction to novel stimuli is part of the mechanism of exploratory moti- 
vation. 
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a E is elicited by external stimuli. We prefer the drive-re- 
lard et wine developed by Hull (1943) and Miller and Dol- 
fe die ), which treats externally elicited drives (such as pain) 
iis etl way as other drives. Furthermore, as Brown (1953b ) 
Salain ae in some of the Wisconsin studies on the “visual 
a te n ar the novel stimuli to be explored are not present 
stimuli ny e animal begins working to secure them. If the novel 
Gitar “tn löit the drive, this would mean that the drive is produced 
e animal has performed the response the drive is supposed 

to be motivating. 
ae as Harlow seems to imply, the same novel stimuli elicit an 
Bt gi 3 drive and simultaneously serve as an exploratory re- 
th, , a strict drive-reduction theory would be unable to deal with 
ese phenomena. However, we believe it is possible that confine- 
ment produces anxiety, restraint is frustrating, or monotony arouses 
a drive of boredom. Indeed, the observation of small children who 


Rie required to sit absolutely still, the reports of prisoners subjected 
© solitary confinement, and the difficulty of Bexton, Heron, and 
riment on the effects of 


Scott (1954) in retaining Ss in their expe 

decreased sensory variation would indicate that such conditions can 
produce strong motivation. Therefore, we suggest that drives pro- 
duced by homogeneous or monotonous stimulation, enforced in- 
action, etc,, may be reduced by sensory variety, freedom of action, 
ete., and that such drive reduction is the reinforcement involved in 
learning for “exploratory,” “manipulatory,” and “exercise” rewards. 
For the present, we choose the more parsimonious alternative of 
trying to analyze such concepts as exploratory drive along the same 


lines as conventional drives. 
We also believe some writers hav 
novel stimuli elicit a drive simply becaus 


elicit activity or exploration. This may we 
the cue properties of a stimulus with possible drive properties. Ex- 


ploration may be an innate response to novelty in some species, or 
it may occur because exploration has been reinforced in the presence 
of novel cues in the animal’s past history- Activity is a poor measure 
of drive; some drives, such as fatigue oF fear, may tend to decrease 


activity. 

Irrespective of how the foregoing problems of theory and inter- 
pretation are handled, we agree that it is extremely important to 
develop techniques for studying significant sources of motivation 
which have previously been neglected. Such studies may lead to 


e been too quick to assume that 
e such stimuli commonly 
Il be a case of confusing 
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fundamental extensions or radical revisions of our present concepts. 


Certainly our present list of experimentally studied motives is far 
too short. 


[8] 

The Effect of Deprivation of Visual 
Incentives on Visual Exploration 
Motivation in Monkeys’ 


ROBERT A. BUTLER 


). Other researches 


at discrimination learning can be established 
when the only apparent reward is the o 


ery & Segall, 1955). There is also evidence 
ngth of exploratory behavior varies with 


A i and Mr. John Joe 
rm i x D 
planning and constructing the apparatus used į; 4 = a for their work i 


sounce: Robert A. Butler, “The Effect of Deprivation of Visual Incentives 
on Visual Paploraion a TOS toi Monkeys,” Journal of Comparative an 
iological Psychology, 1957, 50, 177-179 Re 2t" parative ane 

Prayatologigak EUER on Association and n a Seprinted by permnicc: ae ee 
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ward. Measurable physiological changes take place when food and 
water are denied, and, within certain limits, it is inferred that drive 
strength is directly proportional to the magnitude of these physiolog- 
ical changes. There are no a priori reasons why deprivation of in- 
centives which elicit manipulation and exploration would cause an 
increase in the strength of these motives, since the physiological 
phenomena accompanying this kind of deprivation are by no means 
apparent. If, however, manipulation and exploration are important 
Motivational mechanisms, it is reasonable to hypothesize that 
motivational strength would become greater when animals are de- 
Prived of the relevant rewards. The present experiment was de- 
Signed to determine whether the responsiveness of monkeys to visual 
incentives would increase following restriction of visual exploratory 


experience. 
METHOD 


Subjects 

Five rhesus monkeys (no. 301, 302, 304, 305, and 306), whose weights 
ranged from 6% to 9 lb., participated in this experiment. All Ss had been 
tested previously on a visual exploration problem (Butler & Alexander, 
1955), but they had received no training on any other type of problem. 


Apparatus 
Trstinc Box. During the deprivation and testing periods, the Ss 
were housed in an enclosed box 26 in. long, 16 in. wide, and 30 in. high. 
The box was constructed of 16-gauge aluminum. Metal bars, % in. in 
diameter and spaced 1% in. apart, formed the floor of the box. Directly 
beneath the bars was a metal pan for the collection of urine and feces. 
The inside of the box was illuminated by a 25-w. lamp fixed to its top. 
Circulation of air inside the box was provided by an inner and outer 
series of ventilation holes # in. in diameter located along the top and 
he box. The holes overlapped in such a way that 
animals could not see out. Monkeys were put into the testing box through 
a vertically sliding door at the rear of the box. 7 i 
Centered on the front of the box was a window 34 in. square. Covering 
the window was a motor-operated door which opened outward. A sheet 
vas inserted between the window and the door. 


of Plexiglas 146 in. thick v 

One ond of the Plexiglas was fixed securely to the front of the box while 

the other end could be pushed outward approximately % in. before con- 
ivating a microswitch. The microswitch delivered an elec- 


tacting and acti microsw r 
tric pulse to @ relay which initiated the opening of the motor-operated 


door. By these means, monkeys could cause the door to open by pushing 
against the Plexiglas. During the deprivation periods a metal plate was 
fixed rigidly over the window in place of the Plexiglas sheet. 

ConTrot AND RECORDING UNIT. In an adjacent room a system of 
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relays and a program device were arranged to control the times when the 
door could be activated, In addition, a timer controlled the length of ne 
the door would remain open. The number of responses against the P! Seg 
glas and the number of times the door opened were recorded automa 


f the 
cally on impulse counters. The rate of response was charted on 
cumulative recorder. 


Procedure 


PRELIMINARY TRAINING. Since all Ss had been previously trained MP 
push directly against the door to receive visual reward, they quic! | 
learned to push against the Plexiglas sheet inserted between the box an 
the door. During the beginning stages of preliminary training, the mon- 


‘to look outside the box. Then, in an attempt i 
e measure of motivational strength, monkeys weie 
itions of variable-interval reinforcement. Severa 
loyed until one was found under which monkeys 
ively constant rate of response throughout a 60-min. KA 
i e, a maximum of either 0, 4, 8, 
me the door closed and the time 


presence of temporal cues, For each reinforced response, the door re- 
mained opened for 12 sec, Prelimi ini 


generating a relatively stable r 


FORMAL TESTING. Frequency of responses to visual incentives was 
measured for different durations of visual exploration deprivation. The 
in the testing box with 


lay of either 0, 2, 4, or 8 hr., the Plexiglas sheet 
was quickly inserted in testing was begun. 


roximately 7:30 A.M. 
and testing began at 4:00 P.M. The interior of the box wat illuminated 
throughout the deprivation and testing sessions, 

Presentation of the deprivation conditions followed a 4 by 4 Latin 
square with rows representing animals, columns representing test sessions 
and Latin letters representing deprivation conditions. Two animals were 


assigned to one row of the Square, and each of the other three monkeys 
was assigned to a separate row, Only o 


: me monkey was tested on any day, 
and from four to six days elapsed before the animal was tested again. 
After the Ss had experienced eve 


: TY condition of deprivation, the entire 
formal testing procedure was repeated, thereby giving each animal a total 
of eight test sessions. 


RESULTS 
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ferences between conditions were significant at the .05 confidence 
level. As shown in Figure 1, mean response frequencies increased 
as the duration of deprivation was lengthened. The responsiveness 
of the Ss after 8 hr, of deprivation was only slightly greater than that 
recorded for the 4-hr. deprivation condition. Differences between 


550, 


MEAN FREQUENCY OF RESPONSES 
ò 
° 
= e 


0 2 4 6 
NUMBER OF HOURS OF VISUAL EXPLORATORY DEPRIVATION 


Ficure 1. Mean frequency of responses as a function of duration of depri- 


vation. 


conditions, with respect to number of reinforcements attained, were 
j sured by the Friedman chi-square 


also significant (p < -05) as mea: 
ROE (p wards was 141.0, 149.1, 155.5, and 


test. Mean number of visual re 
157.2 for the 0-, 2-, 4-5 and 8-hr. deprivation conditions, respectively. 


The response/reinforeement ratio tended to increase as the depri- 
vation periods were lengthened, but this trend failed to reach signifi- 
cance at the .05 confidence level. Not all monkeys consistently 
responded more frequently, with increased durations of deprivation. 
Monkey no. 301, however, was the only S whose mean frequency 
of responses was actually less for one of the deprivation conditions 
than it was when there was no deprivation. 

Deprivation appeared to have had a disproportionate effect on 
visual exploration motivation at the beginning of the experiment. 

s 
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Notwithstanding the length of the deprivation period, i.e., 2, 4, baa 
8 hr., four of the five animals responded most frequently on the 


A visual exploration motive is postulated to account for the per- 
formances observed in this experiment. These data indicate that the 


longed might be attributed to two fac 
within the incentive condition, and (b) fai 
to adjust immediately to a test 
degree of control over the ince 


e length of deprivation. 
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whi sg i : . 

hich produce an orderly satiation function of visual exploration 
needs further research. 


Summary AND CONCLUSIONS 
Poe ge monkeys were deprived of a varied visual experience 
ne i = 8 hr. The animals were then tested to determine 
iors r their responses to visual incentives would be increased 
e result of this deprivation. A variable-interval reinforcement 
schedule was used to test the motivational strength of the monkeys. 
Reinforcement consisted of a 12-sec. view of the monkey colony out- 
Side the test cage. The results showed that the number of responses 
to visual incentives approached a maximum after 4 hr. of depriva- 
tion. Differences between mean response frequencies for the various 
conditions were significant at the ‘05 confidence level. These data 
provide another demonstration of the similarities between behavior 
based on a proposed curiosity motive and behavior based on biolog- 
ical drives. 


[9] 
Learning as a Function of Sensory 
Various Intensities ` 


Stimulation of 
ALD G. FORGAYS 


HARRY LEVIN and DON 


s usually thought to occur when responses result 
in stimulus decrease to the organism (egs Hull, 1952). A number 
of recent studies indicate, however, that under certain conditions, 
Â i i i an also be reinforcing (e 
an increase 1n external stimulation can a g go 
Forgays & Levin, 1958; Kish, 1955; Marx, Henderson, & Roberts, 
1955; Montgomery, 1952b). The present series of studies are de- 
signed to explicate certain of these conditions. 


a dies were supported in part by a grant from the Faculty Research 

Cr: Thee ose of Cornell University and in part by a research grant from 

TaN tional Science Foundation. We wish to thank Alan Goldman and Jay 

Se aan for their help with the investigations. 

same Harry Levin and Donald G. Forgays, “Learning as a Function of 

Sensory Stimulation of Various Intensities,” Journal of Comparative and Physi- 
Psychology, 1959, 52, 195-201. Reprinted by permission of the 


ical 
eet Psychological Association and H. Levin and D. G. Forgays. 


Reinforcement i 
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In a previous study (Forgays & Levin, 1958), we investigated 
lever-press learning by food-deprived and food-satiated rats when 
5 sec. of light was the reinforcing agent. In general, the food-de- 
prived animals tended to respond at a higher rate than the food- 
satiated animals. The principal finding of the experiment, however, 
was that the lever-light paired groups responded significantly more 
frequently than their controls and exhibited typical acquisition and 
extinction behavior during the appropriate trials. 

In the above study only a single light intensity was used as a 
reinforcing stimulus. The question arises as to the nature of the 
reinforcing effects of light stimulation of different intensities. 

It is possible that both very bright and very dim lights will not be 
effective positive reinforcers, Extremely bright illuminations can 
be aversive stimuli because they are painful to the organism; low 
illuminations, on the other hand, may not be readily discriminable. 
In this regard Thomson (1955) reports that the reinforcing value of 
stimulus increase varies positively with the degree of change of the 
external stimulus. Marx et al, (1955), using a greater range of 
stimulus intensities than Thomson, report that the amount of rein- 
forcement is related in a rectilinear fashion to light intensity up to 
16 mL. but that stronger intensities of light are aversive stimuli. 


Whether intensities intervening between the extremes will differ in 
reinforcing value is an empirical question, 


of the animals. The second experim 
ing properties of two of the same light i 


EXPERIMENT I. VARIATION of STIMULUS 
INTENSITY 


Method 


Susjecrts. The Ss were 32 albino rats of the Cornell University Psy- 
chology Laboratory strain. Seventeen were male and 15 were female; all 
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were members of five litters born within a few days of each other. Eight 
animals were assigned to each of the four groups constituting the design. 
Males and females of each litter were distributed as equally as possible 
among the groups. Half the animals began acquisition trials when they 
Were approximately 70 days of age; the remainder began 40 days later, 
when they were about 110 days old. All animals were experimentally 
naive prior to beginning this experiment. 

Apparatus. The apparatus consisted of a soundproofed, boxlike en- 
closure whose inside dimensions were 12 in. long, 10% in. wide, and 12 in. 
tall. The interior walls were brown masonite (dull side exposed) covered 
with ¥-in, hardware cloth. The floor was solid; the roof was hinged and 
was used as a door. The single object within the box was a solid bar lever 
2 in. wide, extending % in. into the box through a wall at a point 5% in. 
above the floor and 2 in. from the juncture of two walls. A section 


of the roof consisted of a circular pane of clear glass, 4 in. in diameter, 
above which a 40-w. bulb was mounted outside the box. The bulb was 


wired through a variable rheostat, allowing control of the intensity of 
light emitted. The box was placed in a lightproof and soundproofed 
room. A series of electrical relays was wired in such a way that lever 
pressure led to illumination of the bulb for 5 sec. Further pressure of the 


lever while the light was on had no effect on future appearance of the 
light; the light could only be reactivated after a time-delay relay closed, 
mber of lever presses was recorded 


5 sec. after the onset of light. The nu y Ri 
on an electrical counter. The latency of the first lever press in each tria 
was also recorded. 

Procepure. Each animal was placed singly in the dark box for ar 
min. a day on 20 consecutive days. All ani > d lib. foon 
diet in their home cages; food was nev ned in the experimental 
box by any animal. The three experimen! s ffered in the inten- 
MPa esas aes delivered into th eee 

high-intensity group, the illumination was 39- $ 
intensity group. 146 Ls intensity gor T% mb e 
brightness readings were taken 3 t source wit A i a ee lever 
tric Luckiesh-Taylor Brightness Meter. No illumination ollowe : 
presses of control animals. three experimenta grups 
which differed in the intensity following nae are an 
one control group, the animals o! ed no light after pressing 
the lever. ; — 

The animals, it will be recalled, were run in two puar y en f mi 
run, the second group of animals was about 40 days older a e iita 
group. It became apparent that the younger and ner an s z re differ- 
ently affected by the various illuminations which o! oye | an presses. 
We, therefore, included age as a classification in the analysis below. 


Results 
The two scores available for analysis ar the number of lever 
es for each 12-min. trial and the latency of the first response in 


press 
trjal. For all 32 animals, the two measures correlate —.87, so 


each 
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that they are virtually interchangeable. Analysis of both the response 
and latency measures yield similar results, with only slight differ- 
ences in probability statements. 

From the way the data are grouped, there are, in effect, two 
observations for each animal: the sum of the responses for the first 
10 days and the corresponding sum for the last 10 days. : 

The mean number of responses by animals in the various classifica- 


tions is presented in Table l, and the summary of the analysis of 
variance of these means is in Table 2, 


TABLE l 
Mean Numbers of Responses 


Younger Animals Older Animals 


Combined 
Condition Trials 


. Groups 
Tas Trials 1-20 


1-10 11-20 1-20 1-10 11-20 1-20 


High intensity 10.25 47.25 57.50 65.00 107.50 172.50 115.00 
Medium intensity 67.75 118.50 186.25 56.25 74.50 130.75 158.50 
Low intensity 66.75 90.50 157.95 2275 40.50 63,25 110.25 
Control 5725 53.50 110.75 38.50 2550 59.00 84.87 


——— 


TABLE 2 
Summary of the Analysis of Variance of the Response Data 


Source df Ss MS F p 
Intensity 3 11,214.92 3,738.31 120 N.S. 
Age 1 1,859.76 1,859.76 0.60 N.S. 

Age by Intensity 3 25,959.55 8,653.18 2.78 N.S. 

Tier 24 74,584.88 310770 
B. Within Subjects (32) 26,025.50 

Periods 1 7943.27 7,943.27 15.96 <.001 
Periods by Intensity 3 5,001.30 1,667.10 335 <.05 
Periods by Age 1 346.89 346.89 0.70 NS. 
Periods by Age by Intensity 3 789.92 263.31 053 NS. 

aha 24 11,944.12 497.67 

Total (63) 139,641.61 


e e E a a 


Consider first the analysis of the total number of 
2, Part A). The interaction of intensity and age a 
gatic (p = .07). The nature of this interaction is 


responses (Table 
Pproaches signifi- 
clarified in Figure 
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rao m younger animals, the relationship between intensity of 
brightest okt stimulus and response frequency is curvilinear. The 
the medi 1g rie associated with the fewest number of lever presses, 
pein a Ga with the most responses, and the dimmest light 
of respons -ight (control) conditions with the next fewest number 
inner walt in that order. With the older animals, there is a rec- 
athen on ionship between light intensity and response level. In 
eee S, the major difference between the two age groups 1S the 
Seite which the light of high intensity affects lever pressing: 
differes ated according to Tukey’s gap test, the least significant 
eileen the .10 level of confidence for mean number of re- 
A pring hin each group over the total of 20 trials is 67.46. As can 
group re in Table 1, for the younger animals, the high-intensity 
intensit sponded significantly less than either the medium- or low- 
sieni T and less even than the control gorup, but not 
quently t y so. The medium intensity group responded more fre- 
cant 7 aan the control group. Among the older animals, the signifi- 
theresa are the high and medium, which are similar to each 
Lenten different from the low and control groups. The latter two 
iffer. 

ae section of the analysis of v 
Bae s the differences in the number of responses 
y and late experimental periods. Results show that 


ariance (Table 2, Part B) 
between the 
all groups 


Mean Number of Responses in 20 Trials 


28 32 36 


0.1 1.764 8 12 16 20 24 
Brightness (mL) ————~ 
_ Ficure 1 s 5 i i 
intensity of eee numbers of responses according to age of animals and 
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except the control group responded more frequently in the last ten 
trials than in the first ten trials (p < .001) 


| Mean Number of Responses: final 10 trials — first 10 trials 


40 


30 


oO] 16 4 8 w ie w a a aa 2 


Brightness (mL) —— e 


Fıcune 2. Differences in mean number of responses between two periods 
according to intensity of stimulus, 


In addition, the p 
.05 level of confidence. 


pect to second-period 


increases. When there is no reinforcement, there is an actual decrease 


of response over periods. 

Age of the animals does not rel. 
various light intensities when Pp 
index of learning. 


ate to the reinforcing value of the 
eriod differences are taken as an 


EXPERIMENT II. VARIATION Or AcE AND 
EXPERIENCE OF ANIMALS AND 
STIMULUS INTENSITY 

The results of the above study indicate th 
determinant of effects associated with stimulus intensity, Since the 
age variable appeared somewhat fortuitously in the reported study, 
a second investigation was undertaken to examine directly the 
effects of two intensities of light stimulation, the high and low illu- 
minations of Experiment I, on lever-pressing response levels in 


at age is an important 
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ani. i 
of ae fed ages. Specifically, we wish to see if the results 
elite of ne it y can be replicated and further, to examine the 
response nel experience with a given light intensity upon present 
leads ton] s in animals of different ages when lever pressing 
he onset of that specific light intensity. 


Method 
Sup 
c ology Taba The Ss were 54 albino rats of the Cornell University Psy- 
members of s ratory strain, There were 30 males and 24 females all 
mals were ianen litters born within a few days of each other. Nine ani- 
Sexes were e signed at random to each of six groups so that litters and 
expérimentale ly represented over the groups. Two of the groups began 
egan when Ten when they were approximately 32 days of age, two 
egan when hed were about 80 days of age, and the last two groups 
Mentally nai ey “were about 130 days of age. ‘All animals were experi- 
Rosia prior to initial running. 
above, Gack The same apparatus was used here as in Experiment I 
illumination, two light intensities were employed—the high and the low 
Presses y ns (33.04 and .01 mL., respectively). The number of lever 
was recorded as above. 
eir hom ib. food and water diet in 
e cages. Each animal was placed singly in the dark box for 
f trials to which 
oups of animals 
when they were 32 days of age; 
and a final seri y were 80 days of age, 
al series of ten trials when they were 130 days of age. Two 
f age and received 
f age. Two groups receive 
were 1 
he three pairings 
the other group’s animals received 
Thus, there were six groups 


TABLE 3 
Experimental Design 


Age at Start of Series 


Condition aa ei 
32 days 80 days 130 days 


Bright light Group 1 Group 1 Group 1 
Group 3 Group 3 
Group 5 


Dim light Group 2 Group 2 Group 2 
Group 4 Group 4 
Group 6 
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TABLE 4 


Mean Numbers of Responses for the Various Conditions 
and Significant ts Found (p < .05) 


Time of Testing (Days of Age) 


igni t 
Light Intensity Significant ts 


J n 
32 80 130 BEINKE 
High 23.67 (a) 82.22 (b) 79.44 (c) a, b 
39.78 (d) 102.00 (e) b, d 
94.00 (£) d,e 
Low 21.22 (g) 102.44 (h) 156.33 (i) ca 
Ai 
74.56 (j) 258.77 (k) e,k 
147.67 (1) g h 
jbk 


Results 


We will present the results of Experiment II in two sections. First, 
we will present those results relevant to the effect of age, independ- 
ent of specific prior experience (uncorrelated measures), upor 
response level for each light intensity. Next, we will outline those 
results pertaining to the effects of prior experience and light inten- 
sity upon response level within each of the two relevant age groups. 

AGE EFFECTS INDEPENDENT OF EXPERIENCE. The mean number of 
responses by animals of the various groups, selected ¢ test results, 


ponse figures given for animals initially run at 
32, 80, or 130 days of age. These are the mean 


figures appropriate for 
the analysis of the effect of age and light in gures approp. 


; > intensity of light, and the inter- 
action of these two effects. The Age-of-Animals effect is significant 


at the .01 level of confidence. Reference to Table 4 reveals that 
in each comparison older animals respond at a higher rate than do 
the younger animals. This is true for both the high- and low-intensity 
light groups. The Light-Intensity effect and the Age-Intensity inter- 
action are not significant. 

EFFECTS OF PRIOR EXPERIENCE, 


: In the first part of this section we 
will be concerned with an analys 


is of the data only for the four 
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groups of animals run at 80 days of age; then we will present the 
cg of the data for the six groups of animals run at 130 days 
age. 

Eighty-day-old animals. It will be recalled that of the four groups 
run at this age, two had had previous experience and two were 
introduced to the experimental situation for the first time. The mean 
number of responses for these four groups is presented in Table 4. 
An analysis of variance of these means was conducted. The sig- 
nificant Between-Groups effect which was found was further ana- 
lyzed in terms of its three components: experience, light intensity, 
and the interaction of these two effects. The Experience effect is 
significant (p < .05). For both light intensities, the animals having 
= prior exposure at 32 days of age responded at higher levels than 

id the inexperienced animals. Analysis by t test for uncorrelated 
Means reveals that this comparison is significant at the .02 level of 
ponfideee for the bright-light groups only, and is not significant 
or the dim-light groups. 

The Light-Intensity effect is not significant (p. <.10). In general, 

OWever, animals receiving dim illumination for lever pressing 
Pik dro at higher levels than do animals receiving bright illumina- 

ton. Further analysis by £ test indicates that this comparison 18 
Significant at the .05 level of confidence for the inexperienced 
groups only. Experienced animals receiving dim illumination for 
ever pressing do not respond at a significantly higher rate than do 
experienced animals receiving bright illumination. : 

The Experience-Intensity interaction effect is not significant. 

One-hundred-thirty-day-old animals. The mean number of re- 
Sponses for these six groups is presented in Table 4. An analysis of 
Variance of these means was conducted. The significant Between- 

roups effect which was found was further analyzed in terms of its 
three components: experience, light intensity, and the interaction of 
these two effects. The Experience effect is not significant (p < .20). 
The bright-light and the dim-light groups having had a single expe- 
rience at 80 days of age (a single past experience) tend to respond 
at higher levels than do the remaining two relevant groups (animals 
with no prior experience and those with two prior exposures). Anal- 
ysis by t test reveals that specific comparisons are not significant for 
the pright-light or the dim-light groups. 

The effect of light intensity is significant at the .01 level of con- 
fidence. In general, animals receiving dim illumination for lever 
pressing respond at higher rates than do those receiving bright 
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illumination. Further analysis by ¢ test indicates that this ape 
is significant only for those groups of animals which had prio 
exposure to the experimental situation. 

The Experience-Intensity interaction is not significant. 


DISCUSSION 


In a previous paper (Forgays & Levin, 1958), the writers ee 
that a sensory change following a response acted to reinforce ae 
response. The results of Experiment I here replicate those of ie 
previous study. In addition, as indicated in the present oe nae? 
I and II, there appear to be systematic effects attributable to te 
age of the animal, his experience, and the intensity of the stimulus 
change. ; 
cate that intensity of cers 
lever-pressing response for ligh ! 
s study is the unexpected ipang 
m light while older animals prefer 
ion of these results is necessary. 


experience were studied only in Ex- 


in addition to those discussed above 
he two studies, 
The design of Experiment II 


lever-pressing behavior of ei previous exposures to 


: egardless of the age of the animals 
(80 or 130 days) or the intensity of the light stimulation, one prior 


exposure significantly increases the tate of response. An additional 
exposure has no further effect upon response rate. It appears that a 
ten-day testing period adapts the animal in some way to the experi- 
mental situation and that further testing (experience) does not 
change this adaptation as indexed by response level, 

It is interesting from a developmental Point of view to note the 
effects of experience and light intensity on 80-day-old animals, It 
will be recalled that in both experiments the bright light appears 
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to be an aversive stimulus for these animals. Yet animals that have 
had experience with this same stimulus earlier in life prefer it no 
less than the dim light. Two reasons are suggested for this result: 
(a) the prior experience with the intense light has changed the 
adaptation level of the animals, or (b) the previous handling has 
made them less excitable and less likely to react with fear to an in- 
tense stimulus. 

Why a given light intensity should be avoided by younger animals 
and preferred by older ones and why past experience with light 
Intensities should change these preferences is not clear. Whether 
threshold changes to visual stimulation occur with increasing age 
and experience in the rat is not known to the writers. On the basis 
of such changes we would expect that the specific stimulus values 
Which are positively and negatively reinforcing for young, naive 
animals would not be the same as those for older animals. ; 

Tt might be suggested that the apparently differential reinforcing 
effects associated with variation of stimulus intensity are simply due 
to the increased activity which might be expected to result from an 
Merease of sensory stimulation. On the basis of this point of view, 

Owever, there would be no reason to expect the increased response 
tates in the second half of the trials over the first half, as found in 

‘periment I. Response rate based solely on increased activity asso- 
ciation with stimulus intensity should presumably stay at a constant 
evel over trials as long as the stimulus intensity remains constant 
Or, perhaps, should decrease over trials as a result of fatigue or 
adaptation, The increase which we report in Experment I argues 
against this possibility. o. , ; 

Even more crucial evidence against the activity-intensity notion 
are the latency data which we mentioned briefly above in Experi- 
ment I. The latency (of first response for each trial) data provide 

e€ same results as do the response data presented. However, the 
lateney measure is one which is taken before light stimulation occurs 
in any trial, and hence could not be the result of increased activity 

ue to intensity of sensory stimulation except in the learned manner 
which we have suggested. 


[ 10 ] 


Stimulus Complexity and Sensory 
Reinforcement ' 


GERALD W. BARNES? and ALAN BARON 


While there is no doubt that sensory reinforcement, e.g., — 
contingent dim illumination, produces a radical increase in rate 0 
responding (Antonitis & Barnes, 1961; Kish, 1955; Marx, Henderson, 
& Roberts, 1955), the basic nature of this effect is still not clear. 
Studies of light reinforcement have involved investigation of lever 
responding in a relatively homogeneous experimental environ- 
ment, viz., a Skinner box situation, and discussion of the results has 
been centered around Properties of the response-contingent light 
» Onset, direction of change. Although the ob- 

increases show conclusively that Ss do not 
nate the environment continuously, it is none- 
the visual characteristics of the briefly illumi- 


re important in sensory reinforcement. 


the hypothesis of a 
sponse determination h 


tion being explored was increased. By permitting unlimited 
exploration of three-dimensional stimulus objects, however, the 
experimental procedures of Berlyne and Welker confounded com- 
plexity of stimulation both wi 


1 This research was supported in part by a Srant-in-aid from the Wilson Coe 
Research Fund, University of Maine. 
2 Now at the University of Arkansas. 


source: Gerald W. Barnes and Alan Baron, “Stimulus E TA 
taty: Reinforcement, Lour nal of Comp arative and Physiological Tenha 
1961, 54, 466-469. Reprinted by permission of the American Psychological 
Association and G. W. Barnes and A. Baron. 
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stimulation were limited to the visual modality, and systematic 
variation in stimulus complexity was assured by using as sensory 
reinforcers luminous line drawings appearing on a dark screen just 
above the lever in a Skinner box. 


METHOD 


Subjects 


eee experimentally naive male mice of the C57 Black Subline 6 
ati pe ee tested. The Ss were housed in a large communal living cage 
allowed ad lib. access to food and water there. 


Apparatus 


iñ “Epes consisted of a ventilated Skinner-type box measuring 5% in. 
“lever imensions. At the vertical midline of one flat-black wall (the 
into a het ) a T-shaped aluminum lever with a 2% in. arm protruded % in. 
to the ke ox at a X-in, distance above floor level. A force of 2 gm. applied 
which ever through a %-in. downward are operated a snap-action swite! 
runni in turn operated a ZDG-I 3-0 printing counter, Cramer .01-min. 
adioi ng time meters, and stimulus presentation equipment located in an 
ah ning room. Both data recording and stimulus presentation were 
a aly controlled. 
digital display unit (24 v. 


Industri; dc, Model No. 10229, manufactured by 
ustrial Electronic Engineers 


the ) was affixed, in the horizontal plane, to 
in aside of the %-in. thick “lever wall” behind a circular hole 1% in. 
eft ameter, whose center was 1% in. above floor level and 7% in. to the 
of the vertical midline. The Lucite screen of the display cell was 

ws visible, just above the lever, from the interior of the box through the 
4-in, hole. Three luminous stimulus patterns could be presented on the 
oe screen of the display cell: a filled circle 1% in. in diameter; an open 
Square with 1-in.-long, %-in. sides; and a ¥.in.-high X with 1-in.-long, 
-m-thick arms. These particular stimuli were selected from the 12 
stimuli available on the display cell because they seemed to be aligned 
circle, square, and X in order of increasing complexity. When a pattern 
*ppeared on ‘the display-cell screen, illumination of the otherwise dark 
OX interior was minimal; no other illumination of the box was provided 


at any time. 


Procedure 
The Ss were randomly assigned in equal numbers to five groups and 
tested in the apparatus during a single 54-min. experimental session 
following the basic light-conditioning procedure developed by Barnes 
and Kish (1958). Each 54-min. experimental session was divided into 
in. duration. (a) During the first 18-min. 


ee periods, each of 18-mi u i 
Period (operant Jevel) bar depressions were not followed by presentation 


of a stimulus pattern for any S. (b) During the second 18-min. period 
(conditioning) members of the Circle, Square, and X groups received, 
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conterminously with each bar de 
on the display-cell screen, Th 
three stimulus patterns durin 
bar depression, a different 
minute and each pattem 
presentation of the three 


pression, the appropriate ante pae 
e Ss in the Multiple group receive T 
g conditioning, conterminously with e 
pattern being available during each 4 cre of 
being available for a total of 6 min. Or i 
stimulus patterns for the Multiple group a 
randomized with the restrictions that each pattern appear once du ne 
each 8-min. block of the conditioning period and that no pattern a 
mediately succeed itself, Control group Ss received no responie sonang 
stimulus pattern during the conditioning period. (c) During the 


18-min. period (extinction) bar depressions did not produce stimulus 
patterns for any of the groups. 


RESULTS 


Mean numbers of r 
intervals are displaye 


stimulus-patter variable produced differences in responding during 
both the conditioni 


or analyzing the apparent grovp 
is of “difference scores” as lend- 


ence between these two sets of groups 
did reach significance. Examinati 


prolonged acceleration in response ra 
tion for Multiple and X groups contraste 


: Operant-level (or 
control group) rates rapidly reached by the § 


quare and Circle 


Stimulus Complexity and Sensory Reinforcement 159 


Operant Level Conditioning Extinction 


MEAN NUMBER OF RESPONSES 


18 36 
SUCCESSIVE SIX-MIN.- INTERVALS 


e—e—> Multiple o----- o----- o Circle 


*—-—-x—-« X 

OrrbrGee O Square 

titer 1. Mean number of responses pet minute during successive 6-min. 
als over the entire 54-min, experimental session for each group. 


Taps: It should also be noted that the Multiple group emitted 
hie the same average number of responses during intervals in 
sti on a square or an X was available as the corresponding single 
i mulus groups, but the average rate of the Multiple group over 
a erya in which a circle was available was roughly double that 
or the Circle group. 

Mean total response times and mean average times per response 
(T) during each period are presented in Table 1. Analysis of total 
response times gave interpretations identical with those for response 
frequencies. Although analysis of the mean T data over the three 
periods indicated a significant period trend with both linear and 
quadratic components, the absence of other significant values of F, 
particularly for interaction, indicated no differences in T between 
groups at any period. Thus, T was not a useful measure in differ- 
entiating the groups studied. 

An outstanding feature of the data was an a 
prevailing operant-level response rate to a high, slowly decelerating 
rate as soon as the first reinforced response occurred. This transition 


brupt change from 
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TABLE | 
Mean Total Response Times and Ts° during Each 
Experimental Period 


Mean Total Response j nggi 
Time (in 1/100 min.) Mean T (in 
Group 


Operant Condi- Extinction Operant Condi- Extinction 
Level  tionin 


g Level tioning 
Control 1.12 0.72 0.74 139 


1.21 1.47 
Circle 0.97 155 0.88 0.77 1.30 1.20 
Square 0.98 2.11 0.84 1.26 1.41 1.18 
X 0.88 3.26 1.78 1.25 1.78 1.54 
Multiple 0.76 3.11 l 


76 1.03 1.58 1.38 
° T is the mean average time per response, 


from operant-level rate to a high rate was immediate, with cumu- 


eived reinforcement show- 


rst reinforced response was 
r of responses in the imme- 
- No S showed less than a 
24-fold increase, Rates of the 
agnitude were maintained on the average over 


ng period, with a decelera- 


s ate changes observed in 
sbadiesiinvolving res onse-contingent dim illumination of the entire 
environment (Barnes & Baron, 1961b; Barnes & Kish, 1958), Lumi- 
nous patterns and diffuse over-all] ; Se 
representative of the same basic process, It 


that the immediate conditioning effect accompanying the availability 
of either form oF pap onse-contingent illumination is remarkably 
ee conditioning observed when response- 
contingent food reinforcement is first made available to highly pre- 
trained rats (Skinner, 1938). 
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T 5 
re g RiR doubt that conditioning occurred in all groups 
of the present comets ontingent luminous patterns. Further, the data 
powerful cet nae indicate that stimulus complexity was a 
forcement. Ma Cae: of magnitude of the effects of sensory rem- 

ifétences à 2 ed differences in response rates, attributable to 
observed duri he visual pattern presented as reinforcement, were 
and X grou ing the conditioning period. In addition, the Multiple 
emitted mo PS, exposed to the presumably most complex stimuli, 
The latter es during extinction than during operant level. 
inera conti nding is noteworthy because in no previous study involv- 
condito inuous schedule of sensory reinforcement over an extended 
sequent we period has response frequency in an immediately sub- 
Baines — session exceeded operant-level frequency (€-+ 
show that Baron, 1961b; Barnes & Kish, 1958). The results, then, 
with incre: D E in complexity of visual patterns are associated 
at least ss in the magnitude of the sensory reinforcement effect, 
ment. ithin the range of complexity studied in the present experi- 
ie ieee (1958) has suggested the relevance of information theory 
ment ‘arg phenomena rather analogous to the sensory reinforce- 

levees tect, With respect to the present findings, an extension of 
plexity T's position may be developed by considering stimulus com- 
Stina as an inverse function of the information redundancy in a 
conel us pattern (Attneave, 1954). Attneaves analysis leads to the 
ali aia that the stimuli employed in the present experiment are 
ha circle, square, and X in order of increasing complexity, with 
coral ultiple group presenting classification difficulty. It may be 
PARR that the magnitude of the sensory reinforcement effect 
B to the amount of information presented to S by the sensory 
of Orcer, decreasing redundancy leading to increasing magnitudes 

reinforcement. 

The observed differences betw 
coats of the present study support the suggestion o 

56c) and Berlyne (1955) that increases in novelty and/or com- 
plexity of stimulus objects result in enhancement of associated re- 
Sponse tendencies. However, Berlyne and Slater (1957) have gone 
on to distinguish between two kinds of stimulus complexity: (a) si- 
multaneous complexity, which results from increases in the degree 
of variety of stimuli presented simultaneously (as among the Circle, 
Square, and X groups of the present study ); and (b) successive 
complexity, which results from increases in the degree of variety 


seen the Circle, Square, and X 
f Welker (1956b, 
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of stimuli presented successively (as in the Multiple group of a 
present study). Although Berlyne and Slater have not stated i 
successive complexity has greater reinforcing potential than sane 
taneous complexity, a reasonable extension of their viewpoint ats 
be that changing patterns of stimulation should generate more no : 
elty,” and presumably higher response rates, than unchanging ne 
terns of stimulation. But application of this extension of the pb 
hypothesis to the findings of the present study, while predicting m 
observed superiority of the Multiple group over the Circle anc 
Square groups, cannot account for the absence of any real differ- 
ences between the Multiple group and the X group. 

The limitations of a stimulus novelt 
findings stem, at least in part, from 1 
of novelty. For example, the conse 
cessive presentation of stimulus 


y explanation of the present 
ack of specificity in definitions 
quences to be expected from suc- 
patterns varying in their simulta- 
neous complexity are not clear, In all fairness, however, it must also 
be pointed out that alternative explanations are not readily avail- 


able, and the development of such explanations awaits future 
research, 


[11] 
Facilitation of Exploration by 
Hunger in Rats? 


PHILIP G. ZIMBARDO and NEAL E, MILLER 


Recent experiments on the 
exploratory behavior of rats } 
purpose of the present study w 
of difficulty in these experime: 


effects of hunger and thirst on the 
have yielded equivocal results, The 
as to try to remove a particular source 
nts and, thus, to q 

* This investigation was supported in part by a research grant, M 647, from 
the National Institute of Mental Health of the N 


i ational Institutes of Health, 
Public Health Service, and by a research grant, G-930, from the National 
Science Foundation. 


etermine more de- 


~ source: Philip G. Zimbardo and Neal E. Miller, “Facilitation of Exploration 
by Hunger in Rats,” Journal of Comparative and Physiological Psychology, 1958, 
51, 43-46. Reprinted by permission of the American Psychological Association 
and P. G. Zimbardo and N. E. Miller, 
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behav- 


Facilitation of Exploration by 


finitiv 
ely the relati : 
ir y the relationship between hunger and exploratory 


Mont i 
TE ea found that hunger decreased exploration 
result in a square imbardo and Montgomery (1957) reproduced this 
significant E eet However, Thompson (1953) failed to obtain 
Opposite result me and Adlerstein and Fehrer (1955) found the 
maze, each re S hunger increased the exploration of an irregular 
In all these ex ehia oes relatively small. 
number of BiR et r exploratory drive was inferred from the 
ity” may be Ai sections entered per unit of time. Although “activ- 
inappropriate a measurement of drive in some cases, it seems 
In the stu di ox fatigue, fear, and perhaps for exploratory drive. 
tendencies n cited, the Ss may have been in a conflict between 
thorough] o continue to explore the immediate environment more 
flicting ed hone to move on to explore the next unit. These con- 
the total 2 a may account for the contradictory results because 
of etiatn ver of units traversed is confounded with the amount 
it has ta within each unit. By confining S in a given unit until 
tend eney onpa satiated its tendency tO explore it, the conflicting 
Speed of ford remain in that unit is minimized. Consequently, the 
ering the next unit will be a purer measure of explora- 


to 
ON nonmanoe 
ne g . . 
Coens te was reduced to its simplest fo 
ed by a door into two compartments. A 2X2 design was 


used 
to test the hypothesis. One hungry and one satiated group 
ure comparable to that 


w 
er tested without confinement—a proced 
in the preceding studies (Adlerstein & Fehrer, 1955; Mont- 
1957). 


Somery, 1953c; Thompson, 1953; Zimbardo & Montgomery, 
e tested with the 


Ano 
ther hungry and another satiated group Wer 
artment. After all 


impro i 
proved procedure of a delay in the first comp 
he two compartments 


rou 
om ps had reached asymptote, the novelty of tl 
increased, a change which should accentuate any differences 


de 
pendent on exploratory drive. 


mm, a straight alley, 


Meruop 


Subjects 
Piha aie 20 female albino Wistar rats of the Charles River strain, 
= ut 20, deyi ar at the start of the experiment. They were maintained 
a an a a ibi giako! water and Purina Lab Checkers before the experi- 
7 proper- s were housed in individual cages and were tamed b 
andling for one week prior to the experiment. ° 
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The Ss were tested in a modified Miller acquired-drive ee 
which is diagrammed elsewhere (Miller, 1951, p. 437). It come E 
two compartments each 25 by 6 by 8 in., separated by a metal ies - 
door. The compartments were made as similar as possible, each Aine 
a metal floor, wooden walls, a hinged top, and a glass front. Every at: 
but the glass was painted a flat gray. The floors of both compartm ne 
were balanced on springs, so that $’s weight in the starting ere 
would close a circuit, automatically dropping open the door between as 
after a 2-min, delay period. A an x 
5 stopped when S climbed over th 


placed all four feet on the floor of the s 
A separate apparatus was used for 
and sound of a moving door 
another, It consisted of two ide 
which the Ss had been housed 


ided into approximately equated groups 
which were randomly assi r experimental conditions: z 

1. Satiated-Immediate (SI), Ss on ad lib. diet throughout the experi- 
ment, and door in apparatus dropped immediately upon their placement 
in the start box. 

2. Hunger-Immediate (HI), Ss ona deprivation schedule of a specified 
number of grams of food every 24 hr. (see below), and door dropped 
immediately, 

3. Satiated-Delay (SD), Ss on an ad lib. diet throughout the experi- 
ment and allowed ‘to explore the start box for 2 min. before the door 
dropped and the timer started. 

4, Hunger-Delay (HD), Ss on food depriy 
and allowed to explore the start box for 2 mi 
and the timer started. 

In order to insure a high const ive throughout the experi- 
ment, thereby reducing the danger of distortion of our data resulting 
from a continuing elevation of drive (Reid & Finger, 1955), the Hunger 
rats were maintained on a food-deprivation cycle for 29 days before the 
start of testing. For two weeks the Hunger Ss were on a schedule of 7 gm. 
of Lab Checkers every 24 hrs. This, h 


f of er Yer, appeared to be too severe, 
for several Ss died. Following a day of ad lib. feeding, the Hunger groups 


had their diet increased to 10.5 gm. a day and were maintained on this 
schedule for an additional 15 days. Over the period of almost a month 
of testing, the deprived Ss lost an average of only 0.5 gm, 

Four trials were run in the se andn apparatus to help reduce the 
fear-evoking aspects of the dropping oor and the sudden presentation 
of a novel environment, i.e., the second compartment 


to be explored. 
7o o ~ 


ation schedule (see below) 
n. before the door dropped 
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On ‘ saps 
the exploratory-acquisition trials proper, the Ss were placed in the 
inimi ; systematic influences 


ys being followed by 


ls were allowed to explore the 
ter entering it, put were remove 

2 min. after 
revented by raising 


the . 
AE S had gone, into the second compartment. In order to 
the left c preferences and “position sets,” half the animals were run from 
irection pope into the right one, while half ran in the opposite 
not be fa to control for the possibility that the Delayed groups might 
always a the door when it dropped, while the Immediate groups 
other da: we a Ss were placed in the start box facing the door every 
revealed. bi facing the back on the alternate days- Analysis of the data 
or haiwe consistent or significant differences in running speed within 
when ee any of the four experimental groups between those trials 
were faci s were placed facing toward n 
terms E the back of the apparatus. The analysis © a 
this pairs of trials in order to average out differences resulting from 
a ewe 
ark completion of a trial, each S was placed in a detention cage for 
present min. where, as in the apparatus, nO food or water was ever 
the deg The animals were fed 30 to 60 min. after testing in the apparatus: 
given prived Ss received their specified diet, and the satiated Ss were 
All ere food than they could consume in 24 hr. l 
weight s were run one trial a day. Records were kept of: (a) the rats 
me = , (b) the latency from door drop to entry m the second compart- 
the x (scores were converted by the formula, Speed = 100/seconds), (c) 
Daa position in the apparatus at the time of door drop (only for 
bene and (d) the number of feces and instances of urination during 
are the rats appeared to reach asymptote by the sixteenth trial in 
a 1 of the experiment, the apparatus was modified, and all Ss were 
fe an additional ten trials until their running speeds seemed to be level- 
Seem In this second part of the experiment, the Ss and procedure were 
maaintalnee exactly as in Part 1, but th s was modified to in- 
eon its novelty. The apparatus was designed so that painted metal 
a could be placed over the floors, walls, 
appearance. Accordingly, one compartment was ma 
other was made black. Several manipulatable objects were P 
of the two compartments: springs, a bell, and a metal bar in one, and 
springs and a hollow can in the other. 


Resuitts AND DISCUSSION 


Figure 1 shows mean running speed as a function of number of 
trials. This graph indicates that on the first trial the SI group ran 


faster to get into the second compartment than did the HI group. 
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This difference, which is reliable (¢ = 2.45, p = .05), is comparable 
to the result reported by Zimbardo and Montgomery (1957) that on 
the single test trial used, food deprivation leads to a decrement in 
exploratory maze behavior. The finding that the SI animals oe 
faster, on the average, than the HI animals for the first four trials 


NOVELTY OF APPARATUS 
INCREASED 


HUNGER 
IMMEDIATE 
/ 


SATIATED 
ý IMMEDIATE 


RUNNING SPEED (100/sec.) 


5 


7 
PAIRS OF TRIALS 
Ficure 1, 


Effect of experimental conditi i 
a io nin 
speed. ns on the response of running 


(although not statistically significant) 
of prior research (Mont 
not maintained consist 
16 test trials). 


is also in line with the result 
Somery, 1953c), However, this difference is 


ently over the entire course of testing (i.e. 


that the HD group is per- 
group on the first trial, and 
en the groups is Consistent over trials. The 
rou i i 
to diverge from the curves of the other groupe gees tse a 
stantiated by the significant interaction of Drive X Dela P od x 
Trials (see Table 1). The curve for the HD group laike like a 
learning curve. 


Figure 1 also shows that increasing the novelty of the compart- 


pea 
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mts i c 
on ah ak pk- L Sane the diference between HD and SD 
other hand. Aft etween the Delayed and Immediate groups 07 the 
Second parts oy the scores for the asymptotic trials of the first and 
Sis of covariance (s experiment were averaged separately, an analy- 
or not the differe see Table 2) was performed to determine whether 
results of Part 1 ap obtained in Part 2 could be explained by the 
Not the increase g urthermore, we wanted to determine whether or 
in performance of the HD animals in Part 2 beyond 


their ] 
evel i 5 ae 
l in Part 1 was significant. The analysis indicates that the 


TABLE l 
» (Last four Analysis of Variance of Running-Speed Data 
pairs of trials in Part 1; repeated measurements on same Ss) 
Source of Variance df MS F 
Uncorrelated: 
pee 1 3.286.025 664° 
elay Period 1  1,203.583 2.43 
— X Delay Period 1 2,563,372 5.18° 
etween Ss in sa D 494.572 
Gera: s in same group (Ennor) 13 9 
Trials 3 2.126 - 
Trials x Drive 8 65.027 - 
Trials x Delay Period 3 42.129 — 
Trials x Drive X Delay Period 3 431.613 6.54t 
9 65.947 


° Indi P 
} mua significance beyond the .05 level. 
ates significance beyond the .01 level. 
TABLE 2 
ses of Running-Speed D 
f increased-novelty tria 


Analysis of Covariance 


Summary of Analy ata 
ls in Part 2) 


(Average of last four pairs © 


A m i 
Sourae ef Variation nalysis of Variance 
df MS F df MS E 
e i 1 g24799 842° 1l 12.306 = 
a Period 1 526.111 19.78t 1 922.647 15.25+ 
es ive X Delay Period 1 238.006 8.92° 1 208.635 14.29t 
Error (within Groups) 13 26.694 12 14.600 


© Indicates significance beyond 
} Indicates significance Beyond i yi = 
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Delay Period and Drive X Delayed Period are still significant Ea 
cannot be accounted for by Part 1 differences. In other Wor : 
i produced a reliable increase in the difer 
A series of £ tests to estimate the significance of the decline d 
in Part 1 to the first trial in Part 2 yar 
- Similarly, analysis of excretory icone 
ith regard to fear in the testing ore ‘ 

early trials of Part 1 and the first trial 0 
Part 2. 


preted that the H 
it opened, thus advantageous position to rapidly 
enter the second compartment, 


Reinforcement 


Since there is never any food or water in the apparatus and since 
l k hav of the start box, the ques- 
tion arises, What is reinforci se of going into the second 
; t associated with being re- 
being fed soon after making the running 

are Put in a detention cage for 7 min. and 
not fed for at least 30 min ing returned to the home cage. 
It is improbable that the ï i 


© the second compartment in 


i forcing agent. Alth 
is the only one that showed a leaming-type curve 


did maintain their performance 
over 16 trials, Apparently, explorati G 
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on i i i . . > 
distributed trials of one a day is not sufficient to satiate a rat's 


curiosi ; 
iosity. If opportunity to explore the second compartment is re- 


inforcing. į 
orcing, it should follow that increasing the novelty of the com- 


o should serve to increase the magnitude of the ron 
appeared w, a incentive to making the running ~~. a 
speeds for the oo case in Part 2 with the Delay groupe Levee g 
novelty be mmediate groups did not increase wi a Ses 
Part cause once again the tendency to explore the firs 

ment (also made novel) is confounded with the tendency to 


enter 
the second novel compartment. 


The Hunger-Delay Curve: Learning or Performance? 
Pa wy further experimental manipulation it canno be baci 
Perfo whether the hunger affects (a) “curiosity Or (b) ey bie 
culate of curiosity-reinforced responses. Te B H 
itio: e to run the Ss to asymptote and then reverse the agin’ 
i ns for half of each group. If hunger affects only perfor : 

nterpretation b), there should be an immediate reversal of the 
i a ance of the two subgroups changed to the Se sit 
will oe If, however, hunger affects learning, then the 7 a i p 
iff have acquired a stronger habit, which should cause pa 

erence between the subgroups to persist. 


[ 12 ] 

Toward Some Integration of Learning 
Theories: The Concept of Optimal 
Stimulation * 

CLARENCE LEUBA 


theories in 1948, Hilgard con- 
B factory state,” and he added, 


n Lacey for several sug- 


After a careful review of learnin 
cluded that they were in an “unsa 


‘In preparing this article, I am indebted to Dr. Joh 


gestions. 
: z i f Leaming Theories: 
source: Clarence Leuba, “Toward Some Integration Pa 1958 1, 27-33. 


The C t of Optimal Stimulation,” logical 
eC is arton, Payee Press and C. Leuba. 


Reprinted by permission of Southern Universities 
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“there are no laws of learning which can be taught with pre ol 
(Hilgard, 1948, p. 326). This rather extreme view seems to son 
grown stronger among psychologists during the intervening 7 ted 
One of the contributors to a recent symposium on learning — 
that he was opposed to “patching of what had better be ar 
away” (Snygg, 1954, p. 130). This also is doubtless an extreme V F 
but there is no doubt that an increasing number of psychologi ae 
are questioning whether, for instance, the widely held soon 
tension-reduction view of learning is at all adequate to cover 
non-maturational aspects of human development. ld 
The observations of Harlow (1953b), Hebb (1954), gore 
(1954), McClelland (1958), Montgomery (1954), Kish (195 : 
Kagan and Berkun (1954), and others are indicating ever mom 
clearly that a variety of organisms learn many reactions which bring 
them increased, rather than decreased, stimulation. Thus, rats > 
darkness will press a bar more frequently if chance bar pressing 


‘ ee oe $ : ce 
are accompanied by dim illumination than if such pressings produ 
no increased stimulati 


pressings became extr 
lowed by electri i 


aze itself (Liddell, 1954). Monkeys have 
i ving hasps, hooks, n 
d stimulation produce 

» 1953b). Hebb concludes 
that “mammals seek excitement . , 


y things whi 


ch are tension-producing and 
y to get as muc! 


exciting. They often tr h stimulation as possible out 


of their environment. 
There have been attemp 
tension- or drive-reduction th 


Produce added stimu- 
Y postulate the existence of an 


i aying the old game of assuming 
the existence in man of the very thing we are trying to explain? 


The assumption begs the question anq violates the Principle of par- 
simony. It would be better to admit, it Seems to me, that the drive 


lation reduce this drive. But wh 
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reducti , i 
TE wor theory explains some, but not all the facts of learning. 
sooo animal learning and possibly most human learning seem to 

ur while the general drive state (the over-all stimulation) is 


oe rather than decreasing. 

wise surprising that, until very recently, we should have over- 

ditions pe mie) the fact that much learning occurs under con- 
increasing drive. Perhaps it is partly because 1m most 


sye ¢ : , n mo: 
py hological laboratories, learning has been observed mainly in 
ganisms driven by powerful biological or neurotic drives. The 


| have been deprived of food or water for lengthy periods, 
rotic ee electric shocks; some of the animals have been made neu- 
of air. coe situations, insolvable problems, noises, and blasts 
by elini nese studies have been supplemented during recent decades 
siainen sa 1 ones of anxiety-ridden human beings. Under the sran 
otganis m which the observations and experiments were ma e, 
a did learn to do the things which were tension-, drive-, or 
1949. ation-reducing (Dollard & Miller, 1950; Keller, 1954; Maier, 
tionc Mowrer, 1950; Skinner, 1953). The most obvious interpreta- 
e of this fact is that when organisms are overstimulated they wi 
arn the reactions which lessen that stimulation 


and return it to 

More moderate levels. 
Fn human learning and development, however, does not occur 
‘hen people are deprived of food or water for 12 or more hours, are 
given electric shocks, are under the influence of powerful neurotic 
rives, or are in any situations even remotely resembling these. 
moning situations in the home, nursery, art room, trade school, on 
e playground, college campus, and so on, are frequently of a 


totally different sort. 

Tension reduction would not seem to be a general or the only 
Principle of learning. It may be only one aspect of a more general 
Principle, a principle which might be called one of optimal stimula- 
tion: the organism tends to learn those reactions which will produce 
an optimal level of total stimulation. Hebb writes “animals will al- 
Ways act so as to produce an optimal level of excitation’ (Hebb & 
Thompson, 1954, p- 552). That level is often higher than the one 


Present at the moment. ; 
Hilgard pointed out several years 2g0; that it might be “like a 
breath of fresh air in most learning laboratories” if some one were 
in which he 


the situations 1 
52). Such observations 


d school he is 


a child around and observe 
at he learns (Hilgard, 1948, p- 38 
I believe, that at both home an 


just to follow 
learns and wh 
would indicate, 
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frequently living under circumstances which are lacking in erm 
stimulation and are at least mildly boring. Actions which poa 
stimulation and produce excitement are strongly reinforced, - ee 
times to the dismay of parents and teachers, as compared a other 
reactions performed during more humdrum stimulation. me t 
way of saying this is that reactions which bring the aeons a 
bear upon the sense organs and increase the stimulating capa dey 
of the environment, are reinforced over other reactions; in every’ aE 
but somewhat misleading language, the child is animated by ae 
osity, by a desire to explore, and bya tendency to get reactions 1 
things and people, as by teasing the latter. In the much rarer ing 
stances, when he is over-excited and over-stimulated, as duri 


; ; 3 ; j ; il] gain 
intense emotion, those actions, which are drive reducing, will g 
the ascendancy, 


Both the experimental 


5 ? bser- 
evidence now available and general o 
vations seem to indi 


5 ; a 
cate that the concept of optimal stimulation may 


It is the 
intensity of any one particular 
the stimulus to which the subj 


. ` e 
ntense, as when there is a high degre 


those gaining optimal stimul: 
are accompanied by either too little or too much total stimulation- 
Since exploratory behavior bri 


ation are 


es acquire the capac- 
d reactions, 


Classical conditioning may account for this connection of a re- 
sponse with a particular situation, so 


s that the latter acquires the 
power to elicit it (Guthrie, 1935), Thus, there seem to be two steps 


The Concept of Optimal Stimulation 173 


clearly evi : 
Eo a co pi the learning occurring during early child develop- 
sponses as th reinforcing step, the strengthening of certain re- 
associative ste pared with others, and a second or connective and 
Sponse that al p. But it is the very stimuli which strengthen a re- 
elicit it; hen so become connected with it and 
process. “iia © both steps seem to be parts or as 
effectively wl conditioning aspect of this process also occurs most 
ately high favs the general level of stimulation is at least moder- 
Tn earl. ae & Taylor, 1951; Spence; Farber, & Taylor, 1954). 
what as Las ild development, the typical sequence may be some- 
ment of ee general random behavior, (b) the reinforce- 
stimulation ctivities accompanied by and producing increased 
activities ) Lay rarely the reinforcement of stimulation-reducing 
orcement- si (c) the connection of those activities to the rein- 
classica] < di ucmg stimuli (conditioning). This would make 
nditioning the end-result of a reinforcement process. At 


rst, stimuli i 

a m' 

an hig in the process of being conditioned merely reinforce 
y; eventually they can elicit it, first weakly and then more 


Strongly.2 

aiee in which reactions h 

responses ¢ s to each other, or in which 

ing ma y o symbols has occurred, ind 

(Brog a. aa much wider applications than is genera 

zies, 1937. — Lacey & Smith, 1954; Leuba & Dunlap, 1951; Men- 

as in thi k Hazan, 1949). It may account for sequences of symbols 
nking, as well as for the connection of simple, reflex-like 


reacti 
re to specific overt cues. 

tient re and associationism ar 
fi Vien activities by the general stim 
am i sac of their conditioning 
Siler ee cues which form a P 
stim ce activities seem to be followe' 

ulation rather than to be accompanie 


term 5 
s, the reaction produces satisfying effects. But there is a well- 
al importance of adequate 


2 Many observations point t i 

sti 1 S : o the basic physiologic 

wenn eal cat ct 
Se me an ee “h or EER the cortical visual area in cases of early 
E i It has re pace developed neural structure tenas seny vin 
in sensoril jmpoveris ed i zi pera ue eee ih i ies. 
K PE E aa the 8 have failed to show normal abilities. 
F aa at finer love, ma Sis te dire results allegedly due to the absence 
ot Taman of latin rege for Se T 


acquire the power to 
pects of the same 


ave been conditioned to symbols 
f conditioned 


generalization o 
icate that classical condition- 
lly realized 


both in the reinforce- 
esent at the time, and 
as a whole 


e involved 


ulation pr 
to that stimulation 
t, Sometimes, however, 
d by or to cause increased 
d by it; in Thorndikian 


art of i 
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known tendency for reactions to be made to earlier and sarin 
stimuli in a sequence (anticipation ), The excitement and meen 
stimulation which occur when the baby sees his bottle EnA | 
take place in response to cues normally preceding the naan A 
of the bottle. The rat at first perks up and runs fast only when sé 
food is in sight in the goal box; but eventually this occurs in ig 

e sight of the goal (goal gradient). The ee 
forcing Proprioceptive impulses from muscular tensions wh i 
only as a consequence of an action, a 
aneously with it and thereby evi t 
ted not only while playing with his fat i 
uring the presence of the cues preceomg 
ore, while performing the actions which pa 
Anticipation or expectation of exciting ed 
cumstances may play an important role in the reinforcement of : 
Se (Meehl & MacCorquodale, 1953; Tolman, Ritchie, & Kalish, 
1946), 


coincide with pleasantn, 
The concept of optimal stimulation should be d 
rather than absolute te 
er than in terms of specific stimuli. 
al situation is necessarily 
ating, pleasant or unpleasant. 
ne or the other or as neutral, 
at the moment and what the 
rection of the change that may 
r © much or too little toward a middle 
range; as compared with from the latter toward the extremes, Even 
the stimulation of pain sense organs, as when a child wi gles a loose 
tooth or picks at a scab, may he pleasant and inresistibic if there is 
a change in over-all stimulation fro 


‘ ; m a minimum toward an optimal 
level. Identical stimulation of the same pain sense organs might be 


3 In the chapter on learning of a text, Man—A General P, try to 
demonstrate this connection (New York: Doubleday, in ee RN 


the di 
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unple ; ; g : 
äs oe painful if against a background of excessive stimulation 
Satna E a state of anxiety. In this case, stimulation of the pain 
lation rgans is added to an already excessive general level of stimu- 


only mildly stimulating, as in 


When ex 
n external circumstances are 
s, one woul 


th 
pestle the usual eyelid conditioning experiment 
conditions n T individuals to condition most rapidly. Under 
igh level of high external stimulation, however, the latter's already 
excessive on internal stimulation might lead to an over-all state of 
might be stimulation unfavorable to conditioning. In general, it 
when a Erai that the relaxed individual would condition best 
uring a high level of motivation and stimulation prevailed 
OaS and conversely for the tense individual. 
A a stimulation at any one moment may be anywhere along 
ere cea from minimal to excessive. Optimal stimulation could 
is he —_ by a band somewhere between those two extremes. 
shift ai would not maintain a fixed position, however, for it would 
Sense: pease slightly up and down depending upo” such factors as 
ie sensitivity and the connections and conditions in the 
initiatin yon A stimulus impinging upon fresh sense organs and 
ora dr g nerve impulses in fibers possibly sensitized by a hormone 
impin ug, may have far more stimulating effects than similar stimuli 
is ci emg upon fatigued sense organs OF when a depressant drug 
irculating in the blood stream. It is conceivable, as we have seen, 


tha p 4 > 
a stimulus which at one time was part of a reinforcing state of 
airs might at another time be part of an overstimulating state. It 

t that a generaliza- 


sti as that stimulus is seen in its entire context th e z 
pa may be possible. The suggested principle of optimal stimulation 
1 erges from the total situation; and its existence may be over- 
ooked by those occupied in studying the reactions of organisms to 


Specific stimuli. 

For those attempting to modify behavior, as through education or 
counseling, the implications of a principle of optimal motivation 
may be great. Quite different procedures are indicated if learning 
in daily life occurs rarely, rather than ordinarily, through tension 
reduction. One function of the teacher may be, for most pupils, to 
ensions somewhat and to make the school situation a 


increase t 
rather exciting one- Learning may occur best when stimulation is 
ent, but not strong 


ough to provide maximum reinforcem 


strong en" 
be disruptive. 


enough to 
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Drives and the C.N.S. (Conceptual 
Nervous System) * 


D. O. HEBB 


» Or “conceptual nervous y 
Which Skinner disavoweq and from whose influence he and pee 
nceptual nervous system of i“ 
being drunk about the same time; 


> the conceptual nervous system of 1930 is 


—let us use the best brand of 
neurology we can find, 


Though I Personally favor bot 


moderation, the point here does 


neural anatomy; but merely adhering to certain classical frame- 
works shows the limiting eff iam eurologizing, Bergmann 
(1953) has recently said again that it is logically possible to escape 
influence. This does not change the fact that, in practice, it has 
not been done. 

Further, as I read Bergmann, I am not sure that he really thinks, 
deep down, that we should 


swear off neurologizing entirely, or at 
* Presidential address, Division 3, at American Ps hiclogi, jation, 
Nam Zork, September 1054 Ee paper incorporates idese nyc soca in 
discussion oe ne ee at ea fsPecially Dalbir Bindra and Peter 
Milner, as well as with Leo Postman at Ca fornia, and iti : a 
my great indebtedness to them. it is a pleasure to reco 


source: D. O. Hebb, “Drives and the C.N.S, (Conceptual s Sys- 
tem),” Psychological Review, 1955, 62, 243-254, eprinted Ty ue PE 
the American Psychological Association and D. O. Hebb, 
| 176 
- — 
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hee a all do so. He has made a strong case for the 
struct im e a arity of intervening variable and hypothetical con- 
than of aa Te that we are dealing more with differences of degree 
initia aera he conclusion I draw is that both can properly appear 
Most profital Al using intervening variables to whatever extent is 
being etd. e (as physics for example does), and conversely not 
might be id to use some theoretical conception merely because it 
For samp anatomically identifiable. , 
(19 48) disth conceptions, at least, MacCorquodale and Meehl’s 
tered — is relative, not absolute; and it must also be ob- 
oath : at physiological psychology makes free use of dispositional 
for = s” as well as “existential” ones. Logically, this leaves room 
aace of us to make more use of explicitly physiological con- 
re than others, and still lets us stay in communication with one 
es er, It also shows how one’s views concerning motivation, for 
is mple, might be more influenced than one thinks by earlier physio- 
le notions, since it means that an explicitly physiological 
ception might be restated in words that have—apparently—no 
Physiological reference. 
What I propose, therefore, is to look at motivation as it relates to 
the c.n.s.—or conceptual nervous system—of three different periods: 
as it was before 1980, as it was say 10 years ago, and as it is today. 


Thope to persuade you that some of our current troubles with moti- 
vation are due to the ¢-n-5- of an earlier day, and ask that you look 


with an open mind at the implications of the current one. Today's 
physiology suggests new psychological ideas, and I would like to 
persuade you that they make psychological sense, no matter how 
they originated. They might even provide common ground—not 


necessarily agreement, but communication, something nearer to 
agreement—for peop esent may seem completely 


Je whose views at pr 
opposed. While writing this paper I found myself having to make a 
change in my OW? theoretical p 


osition, as you will see, and though 
you may not adopt the s 


ame position you may be willing to take 
another look at the evidence, and consider its theoretical import 
anew. 


t as well to be explicit about the use of the 
a Motivation refers here in a rather gen- 
the energizing of behavior, and especially to the sources 
of energy in 3 particular set of responses that keep them temporarily 
dominant ove" others and account for continuity and direction in 
behavior. Dr ded as a more specific conception about the 


n it is jus 
and drive. 


eral sense to 


ive is regar! 
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: ae hi s 
way in which this occurs: a hypothesis of motivation, which a 
the energy a function of a special process distinct from those 


te S A e ere- 
or cognitive functions that are energized. In some contexts, th 
fore, motivation and drive are interchangeable, 


MOTIVATION IN THE CLASSICAL 
(Pre-1930) C.N.S. 

The main line of descent of psycholo 
tried to show (Hebb, 1953), 
stimulus-response formulations 


gical theory, as I have ar 
is through associationism and th 
‘ Characteristically, conn namin 
as more or less inactive unless sub- 
arousal. These conditions are first, 


to the law, habits—steering functions—are acquired only in conjunc- 
tion with the operation of drives, 

Now it is evident that a i 
when there is little or no dri 


drives—activity, exploratory, mani atory, and so forth. The other 

is to postulate acquired or learned dri 

so to speak, from association with p 
It is important to see the difficulties to be met by this kind of 

formulation, though it should be said a 

decisive refutation of it, and other ap 
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Fi 
ma overlook the rather large number of forms of be- 
plus leni a MT cannot be reduced to biological drive 
may be for ae = behavir is most evident in higher species, and 
stricted oo r y those who work only with the rat or with re- 
that we put ha s of the behavior of dog or cat. (I do not suggest 
niente ea TOi motivation on a different plane from that of 
itis oE moiy k 1953b]; what I am saying is that certain peculiar- 
vident in a ion increase with phylogenesis, and though most 
is the drive va m be clearly seen with other higher animals.) What 
todel cf a “ae produces panic in the chimpanzee at the sight of a 
aggression i. — head; or fear in some animals, and vicious 
chimpanzee? = a at the sight of the anesthetized body of a fellow 
Genet ce rl V = about fear of snakes, or the young chimpanzee’s 
“anxiety J ee ht of strangers? One can accept the idea that this is 
the eas eh anxiety, if so, is not based on a prior association of 
Teni s ject with pain. W ith the young chimpanzee reared in 
mother at he the Yerkes Laboratories, after separation from the 
Shake befo irth, one can be certain that the infant has never seen a 
Ott aan h re, and certainly no one has told him about snakes; and 
tunity to és are that a particular infant has never had the oppor 
ae a bias a strange face with pain. Stimulus generalization 
me xp ain fear of strangers, for other stimuli in the same class, 
Hack — attendants, are eagerly welcomed by the infant. 
Fors ie at drive shall we postulate to account for the manifold 
objectiv wF in the chimpanzee that do not derive from frustration 
the ely defined (Hebb & Thompson, 1954)? How account for 
ion petting behavior of young adolescent chimp hich Nis- 
d (1953) has shown is independent of prima 
: eal with the behavior of the female who, 
is terrified at the sight of the baby as it drops 
io away, never sees it again after it has been taken to the nursery 
Or: rearing; and who yet, on the birth of a second infant, promptly 
picks it up and violently resists any effort to take it from her? 
There is a great deal of behavior, in the higher animal especially, 


that is at the very best difficult to reduce to hunger, pain, sex, and 
Jus learning. Even for the lower animal it has been 


maternal drives, P: 

clear for some time that we must add an exploratory drive (if we 
are to think in these terms at all), and presumably the motivational 
phenomena recently studied by Harlow and his colleagues (Butler, 
1953; Harlow, 1953a; Harlow, Harlow, & Meyer, 1950) could also 
be comprised under such a drive by giving it 2 little broader 
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specification. The curiosity drive of Berlyne (1950) and ba 
and Solomon (1954), for example, might be considered to cover bo : 
investigatory and manipulatory activities on the one hand, and = 
ploratory, on the other. It would also comprehend the penen 
seeking” behavior recently studied by Mahut and Havelka at Mc 
(unpublished studies). They have shown that the rat wich, * 
offered a short, direct path to food, and a longer, variable and 
direct pathway involving a search for food, will very frequently 
prefer the more difficult, but more “interesting” route. ME 
But even with the addition of a Curiosity-investigatory-manipul ba 
tory drive, and even apart from the primates, there is stil] behavior 
that presents difficulties. There are the reinforcing effects of incom- 
plete copulation (Sheffield, Wulff, & Backer, 1951) and of saccharin 
intake (Sheffield & Roby, 1950; Carper & Polliard, 1953), which do 
not reduce to secondary reward, We must not multiply drives 
beyond reason, and at this point one asks whether there is no alterna- 


tive to the theory in this form. We come, then, to the conceptual 
nervous system of 1930 to 1950, 


f view, to see human beings 
Vidence that an animal might 


to fire in synchrony, bears witness to 
do when it likes. This is like a whole powder ma: loding at 
once. Ordinary behavior can be thought set exploding 
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i pi of much smaller explosions, and so a “self-motivating” 
it oe me nt en be a very powerfully motivated one. To me, then, 
fess" ps en hing that a critic could refer to mine as @ “motivation- 
eae tl ogy: What I had said in short was that any organized 
that the h he brain is a motivated process, inevitably, inescapably; 

uman brain is built to be active, and that as long as it is 


su i A 
pplied with adequate nutrition will continue to be active. Brain 
or, and so the only behavioral 


ay is what determines behavi 
P i em becomes that of accounting for inactivity. 
i a in this conceptual frame that the behavioral picture seemed 
A oe the notion of drive, as a separate energizer of behavior. 
oe experiment reported earlier (Hebb, 1930) had been 
ae impressive in its indication that the human liking for work is 
7 oe rare phenomenon, but general. All of the g00-odd pupils in 
inf y school, ranging from 6 to 15 years of age, were suddenly 
ormed that they need do no work whatever unless they wanted 


to, that the punishment for being noisy and interrupting others’ work 
nd that the reward for 


het to be sent to the playground to play, a 

eing good was to be allowed to do more work. In these circum- 
gg all of the pupils discovered within a day or two that, within 
Imits, they preferred work to no work (and incidentally learned 


more arithmetic and so forth than in previous years ). 


The phenomenon of work for its own sake is familiar enough to 
all of us, when the timing is controlled by the worker himself, when 
tivity imposed from 


work” is not defined as referring alone to ac 
e form of trying to under- 


without, Intellectual work may take th 

stand what Robert Browning was trying to say (if anything), to dis- 
cover what it is in Dali’s paintings that can interest others, or to 
predict the outcome of a paperback mystery. We systematically 


underestimate the human need of intellectual activity, in one form 
al component in art 


or another, when we overlook the intellectu: 
and in games. Similarly with riddles, puzzles, and the puzzle-like 
games of strategy such as bridge, chess, and go; the frequency with 
which man has devised such problems for his own solution is a most 
significant fact concerning human motivation. 

It is, however, not necessarily a fact that supports my earlier 
view, outlined above. It is hard to get these broader aspects of 
human behavior under laboratory study, and when we do we may 
expect to have our ideas about them significantly modified. For 
my views on the problem, this is what has happened with the experi- 
ment of Bexton, Heron, and Scott (1954). Their work is a long step 
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toward dealing with the realities of motivation in the well-fed, 
physically comfortable, adult human being, and its results raise a 
Serious difficulty for my own theory. Their subjects were paid hai 
somely to do nothing, see nothing, hear or touch very little, for 24 
hours a day. Primary needs were met, on the whole, very well. The 
subjects suffered no pain, and were fed on request. It is true that a 
could not copulate, but at the risk of impugning the virility © 
Canadian college students I point out that most of them would not 
have been copulating anyway and were quite used to such long 
stretches of three or four days without primary sexual satisfaction. 
The secondary reward, on the other hand, was high: $20 a day plus 
room and board is more than $7000 a year, far more than a student 
could earn by other means. The subjects then should be highly 
motivated to continue the experiment, cheerful and happy to be 
allowed to contribute to scientific knowledge so painlessly and 
profitably. 

In fact, the subject was well] motivated for perhaps four to eight 
hours, and then became increasingly unhappy. He developed a need 
- In the first preliminary explora- 
listen to recorded material on 
jects were given a talk for 6-year-old children on 


college student, 15 to 20 times in 


report. The subjects looked forw 


outside it, gave up the secondary reward of $20 a day to take up a 
job at hard labor paying $7 or $8 a day, 


as a difficulty for drive 
Se ee ee Tont is how I saw it, Tt will make 
we have already seen the necessity, on oth 
sort of exploratory-curiosity-manipulato 
comes down to a tendency to seek varied 
on the whole handle very well the motivational phenomena ob- 
served by Heron’s group. 
Instead, I cite their experiment as making esential trouble for my 
own treatment of motivation (Hebb, 1949) as Bae a aged 
ceptual nervous system of 1930 to 1945, If the thought process is 
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why should it break down in 


internally organized and motivated, 
] disturbance in- 


Pec of perceptual isolation, unless emotiona 
pone a = it did break down when no serious emotional change 
tice di ns g with problem-solving and intelligence-test perform- 
s ignificantly impaired. Why should the subjects themselves 

port (a) after four or five hours in isolation that they could not 


fi : 
ollow a connected train of thought, and (b) that their motivation 
24 hours or more 


study or the like was seriously disturbed for 

alter coming out of isolation? The subjects were reasonably well 

ra tee happy, and able to think coherently for the first four or 

a hours of the experiment; why, according to my theory, should 

b is not continue, and why should the organization of behavior not 
e promptly restored with restoration of a normal environment? 
You will forgive me perhaps if I do not dilate further on my own 

theoretical difficulties, paralleling those of others, but turn now to 


the conceptual nervous system of 1954 to ask what psychological 


values we may extract from it for the theory of motivation. I shall 
Ities we have considered 


not attempt any clear answer for the difficu 

—the data do not seem yet to justify clear answers—but certain con- 
ceptions can be formulated in sufficiently definite form to be a 
background for new research, and the physiological data contain sug- 
gestions that may allow me to retain what was of value in my earlier 
Proposals while bringing them closer to ideas such as Harlow’s 
(1953a) on one hand and to reinforcement theory on the other. 


Morivartron AND C.N.S.IN 1954 

For psychological purposes there are two major changes in recent 
ideas of nervous function. One concerns the single cell, the other 
an “arousal” system in the brain stem. The first I shall pass over 
briefly; it is very significant, but does not bear quite as directly upon 
our present problem. Its essence is that there are two kinds of activ- 
ity in the nerve cell: the spike potential, or actual firing, and the 
dendritic potential, which has very different properties. There is 
now clear evidence (Clare & Bishop, 1955) that the dendrite has a 
“slow-burning” activity which is not all-or-none, tends not to be 
transmitted, and lasts 15 to 30 milliseconds instead of the spike’s 


one millisecond. It facilitates spike activity (Li & Jasper, 1953), but 
often occurs independently and may make up the greater part of 
is always active, but 


the EEG record. It is still true that the brain 
the activity is not always the transmitted kind that conduces to 
behavior. Finally, there is decisive evidence of primary inhibition 
function (Lloyd, 1941; Eccles, 1953) and of a true fatigue 


in nerve 
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that may last for a matter of minutes instead of milliseconds (Brink, 
1951; Burns, 1955). These facts will have a great effect on the 
hypotheses of physiological psychology, and sooner or later on 
psychology in general. ; 

Our more direct concern is with a development to which atten- 
tion has already been drawn by Lindsley (1951): the nonspecific 
or diffuse projection system of the brain stem, which was shown by 
Moruzzi and Magoun (1949) to be an arousal system whose activ- 
ity in effect makes organized cortical activity possible. Lindsley 
showed the relevance to the problem of emotion and motivation; 
what I shall attempt is to extend his treatment, giving more weight 
to cortical components in arousal. The point of view has also an 
evident relationship to Duffy’s (1941). 1 

The arousal system can be thought of as representing a second 
major pathway by which all Sensory excitations reach the cortex, aS 
shown in the upper part of Figure 1; but there is also feedback from 


SENSORY NUCLEUS: 
CUE FUNCTION 


NPS: NONSPECIFIC 
PROJECTION SYSTEM 
("AROUSAL SYSTEM") 


Ficure 1. 
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pe Se and I shall urge that the psychological evidence further 
phasizes the importance of this “downstream” effect. 
m a = PN Cra of sensory function, input to the cortex 
sensory Gee ae ap a cee only: : from sensory nerve to 
thalamus and feos di i ie ager rome He oho 
oE the sins eres irec y pane the sensory projection areas 
eei a rete n pone sensory routes, the quick 
inefficient; the seido nir erm en dpa a a 
thicket A y ,» as : were, trick es through a tangled 
Besani = and synapses, there isa mixing up of messages, and 
FE pons 5 ra i are delivered indiscriminately to wide cor- 
oe as. In short, they are messages no longer. They serve, instead, 
one up the cortex, with a background supporting action that is 
completely necessary if the messages proper are to have their effect. 
Without the arousal system, the sensory impulses by the direct route 
reach the sensory cortex, but go no farther; the rest of the cortex 
is unaffected, and thus learned stimulus-response relations are lost. 
The waking center, which has long been known, is one part of this 
larger system; any extensive damage to it leaves a permanently inert, 
comatose animal. 

Remember that in all this I am talking conceptual nervous system: 
making a working simplification, and abstracting for psychological 
purposes; and all these statements may need qualification, especially 
since research in this area is moving rapidly. There is reason to 
think, for example, that the arousal system may not be homogeneous, 
but may consist of a number of subsystems with distinctive func- 
tions (Olzewski, 1954). Olds and Milner’s (1954) study, reporting 
“reward” by direct intracranial stimulation, is not easy to fit into 
the notion of a single homogeneous system. Sharpless’ (1954b ) 
results also raise doubt on this point, and it may reasonably be an- 
ticipated that arousal will eventually be found to vary qualitatively 
as well as quantitatively. But in general terms, psychologically, we 
can now distinguish two quite different effects of a sensory event. 
One is the cue function, guiding behavior; the other, less obvious 
but no less important, is the arousal or vigilance function. Without 
a foundation of arousal, the cue function cannot exist. 


And now I propose to you that, whatever you wish to call it, 
arousal in this sense is synonymous with a general drive state, and 


the conception of drive therefore assumes anatomical and physio- 
logical identity. Let me remind you of what we discussed earlier: 
the drive is an energizer, but not a guide; an engine but not a 
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steering gear. These are precisely the specifications of a “A 
arousal system. Also, learning is dependent on drive, accor mae 
drive theory, and this too is applicable in general terms—no mai 
no learning; and efficient learning is possible only in the Ee 
alert, responsible animal, in which the level of arousal is high. sah 

Thus I find myself obliged to reverse my earlier views and re 
the drive conception, not merely on physiological grounds but ark 
on the grounds of some of our current psychological studies. ie 
conception is somewhat modified, but the modifications may no 
entirely unacceptable to others, 

Consider the relation of th 


; al 
e effectiveness of cue function, actu 
or potential, to the level of 


arousal (Figure 2), Physiologically, we 


Original Level of 
response and learning 


Increasing 
alertness, interest, 
Positive emotion 


Increasing 

emotional 

disturbence, 
anxiety 


Level of "cue function" 
(or possibility thereof) 


| point of waking 
Sleep 


Level of "arousal function" (nonspecific cortical bombardment) 


Ficune 2, 


arousal will tend to be repeated. This is represented by the rising 
curve at the left. But when arousal is ata high level, as at the right, 
the greater bombardment may interfere with the delicate adjust- 
ments involved in cue function, perhaps by facilitating irrelevant 
responses (a high D arouses conflicting sH p s?). Thus there will be 
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an optimal level of arousal for effective behavior, as Schlosberg 
(1954) has suggested. Set aside such physiologizing completely, and 
we have a significant behavioral conception left, namely, that the 
same stimulation in mild degree may attract (by prolonging the 
pattern of response that leads to this stimulation) and in strong 
degree repel (by disrupting the pattern and facilitating conflicting 
or alternative responses). 

; The significance of this relation is in a phenomenon of the greatest 
importance for understanding motivation in higher animals. This is 
the positive attraction of risk taking, or mild fear, and of problem 
solving, or mild frustration, which was referred to earlier. Whiting 
and Mowrer (1943) and Berlyne (1950) have noted a relation 
between fear and curiosity—that is, a tendency to seek stimulation 
from fear-provoking objects, though at a safe distance. Woodworth 
(1921) and Valentine (1930) reported this in children, and Wood- 
worth and Marquis (1947) have recently emphasized again its 
importance in adults. There is no doubt that it exists. There is no 
doubt, either, that problem-solving situations have some attraction 
for the rat, more for Harlow’s (1953a) monkeys, and far more for 
man. When you stop to think of it, it is nothing short of extraordi- 
nary what trouble people will go to in order to get into more trouble 
at the bridge table, or on the golf course; and the fascination of the 
murder story, or thriller, and the newspaper accounts of real-life 
adventure or tragedy, is no less extraordinary. This taste for excite- 
ment must not be forgotten when we are dealing with human moti- 
vation. It appears that, up to a certain point, threat and puzzle have 
positive motivating value, beyond that point negative value. 

I know this leaves problems. It is not any mild threat, any form 
of problem, that is rewarding; we still have to work out the rules for 
this formulation. Also, I do not mean that there are not secondary 
rewards of social prestige for risk taking and problem solving—or 
even primary reward when such behavior is part of lovemaking. 
But the animal data show that it is not always a matter of extrinsic 
reward; risk and puzzle can be attractive in themselves, especially 
for higher animals such as man. If we can accept this, it will no 
longer be necessary to work out tortuous and improbable ways to 
explain why human beings work for money, why school children 
should learn without pain, why a human being in isolation should 
dislike doing nothing. 

One other point before leaving Figure 2: the low level of the 


curve to the right. You may be skeptical about such an extreme loss 
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of adaptation, or disturbance of cue function and S-R relations, with 
high levels of arousal. Emotion is persistently regarded as energizing 
and organizing (which it certainly is at the lower end of the scale, 
up to the optimal level), But the “paralysis of terror” and related 
states do occur. As Brown and Jacobs (1949, p. 753) have noted, 
“the presence of fear may act as an energizer . . . and yet lead in 
certain instances to an increase in immobility.” Twice in the past 
eight months, while this address was being prepared, the Montreal 
newspapers reported the behavior of a human being who, suddenly 
finding himself in extreme danger but with time to escape, simply 
made no move whatever. One of the two was killed; the other was 
not, but only because a truck driver chose to wreck his truck and 
another car instead, Again, it is reported by Marshall (1947), in a 
book that every student of human motivation should read carefully, 
that in the emotional Pressure of battle no more than 15 to 25 per 


cent of men under attack even fire their rifles, let alone use them 
efficiently. 


convincing. There are certainly regions in the h 
control eating, for example; but is thi 


Stevenson (1950) have shown that the 
But this issue should not be press 
knowledge. I have tried to avoid dog 


Opposite is true, 
ed too far, with our present 
matism in this presentation in 
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the hope that we might try, for once, to see what we have in common 
in our views on motivation. One virtue of identifying arousal with 
drive is that it relates differing views (as well as bringing into the 
focus of attention data that may otherwise be neglected). The im- 
portant thing is a clear distinction between cue function and arousal 
function, and the fact that at low levels an increase of drive inten- 
sity may be rewarding, whereas at high levels it is a decrease that 
rewards. Given this point of view and our assumptions about arousal 
mechanisms, we see that what Harlow has emphasized is the extero- 
ceptively aroused, but still low-level, drive, with cue function of 
course directly provided for. In the concept of anxiety, Spence and 
Brown emphasize the higher-level drive state, especially where there 
is no guiding cue function that would enable the animal to escape 
threat. The feedback from cortical functioning makes intelligible 
Mowrer’s (1952) equating anxiety aroused by threat of pain, and 
anxiety aroused in some way by cognitive processes related to ideas 
of the self, Solomon and Wynne’s (1950) results with sympathec- 
tomy are also relevant, since we must not neglect the arousal effects 
of interoceptor activity; and so is clinical anxiety due to metabolic 
and nutritional disorders, as well as that due to some conflict of 
Cognitive processes. 
Obviously these are not explanations that are being discussed, 
but possible lines of future research; and there is one problem in 
particular that I would urge should not be forgotten. This is the 
cortical feedback to the arousal system, in physiological terms: or 
in psychological terms, the immediate drive value of cognitive proc- 
esses, without intermediary. This is psychologically demonstrable, 
and has been demonstrated repeatedly. 
Anyone who is going to talk about acqui 
motivation, should first read an old paper b 


showed that with a young child you can easi 
caterpillar or a furry animal, but cannot condition fear of opera 


glasses, or a bottle; in other words, the fear of some objects, that 
seems to be learned, was there, latent, all the time. Miller (1951) 
has noted this possibility but he does not seem to have regarded it 
very seriously, though he cited a confirmatory experiment by Breg- 
man; for in the same passage he suggests that my own results with 
chimpanzee fears of certain objects, including strange people, may 
be dealt with by generalization. But this simply will not do, as 
Riesen and I noted (Hebb & Riesen, 1948). If you try to work this 
out, for the infant who is terrified on first contact with a stranger, 


red drives, or secondary 
y Valentine (1980). He 
ly condition fear of a 
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an infant who has never shown such terror before, and who has 
always responded with eager affection to the only human beings he 
has made contact with up to this moment, you will find that this is 
a purely verbal solution. 

Furthermore, as Valentine observed, you cannot postulate that 
the cause of such fear is simply the strange event, the thing that has 
never occurred before. For the chimpanzee reared in darkness, the 
first sight of a human being is of course a strange event, by defini- 
tion; but fear of strangers does not occur until later, until the chim- 
panzee has had an Opportunity to learn to recognize a few persons. 
The fear is not “innate” but depends on some sort of cognitive or 
cortical conflict of learned responses. This is clearest when the baby 
chimpanzee, who knows and welcomes attendant A and attendant 
B, is terrified when he sees A Wearing B’s coat. The role of learning 
is inescapable in such a case. 


The cognitive and learning element may be forgotten in other 


fundamentally important: Ghent (1951) has shown this, Sheffield 
eement, and so does the work of 


zack (1954) has demonstrated recently that even pain responses 
involve learning. In Harlow’s (1953a) results, of course, and Mont- 
gomery’s (1953b), the cognitive element is obvious. 

These cortical or cognitive components in motivation are clearest 
when we compare the behavior of higher and lower species. Appli- 


cation of a genuine comparative method is essential, in the field of 
motivation as well as of intellectual fı 


unctions (Hebb & Thompson, 
1954). Most disagreements between us have related to so-called 
“higher” motivations. But the evidence I have discussed today need 
not be handled in such a way as to maintain the illusion of a com- 
plete separation between our various approaches to the problem. 
It is an illusion, I am convinced; we stil] have many points of dis- 
agreement as to relative emphasis, and as to which of several 
alternative lines to explore first, but this does not imply fundamental 
and final opposition. As theorists, we have been steadily coming 
together in respect of ideational (or representative, or mediating, or 


itive) processes; I believe that the same thing can happen, and 
a ace in the field of motivation. PP 


[ 14 ] 
Conflict and Information-Theory Variables as 


Determinants of Human Perceptual 
Curiosity * 
D. E. BERLYNE? 


The much-needed integration of the theory of perception with gen- 


eral behavior theory would seem to require some account of the mo- 
tivational factors underlying perception. In laboratory experiments, 
Es usually induce artificial motives in human Ss by imposing specific 
tasks on them, Spontaneous human perceptual activities outside the 
laboratory, on the other hand, have been ascribed by some writers 
to such motives as “effort after meaning” (Bartlett, 1932) or “will 
to perceive” (Woodworth, 1947), reminiscent of the exploratory 
drives that are commonly invoked to explain exploratory behavior 
in animals (Berlyne, 1950; Harlow, Harlow, & Meyer, 1950; Mont- 


gomery, 1954). 
The application of the concepts 0 
to this new area calls for some circumspection and some justification, 


as there may be more parsimonious ways of describing the facts. For 
example, the investigatory-reflex theory (Pavlov, 1927; Sokolov, 
1955) may perhaps be adequate to account for orienting movements 
which afford a clearer or intenser perception of some stimulus object 
to which an organism is already exposed. The theory is, however, 
inapplicable when the response resulting in optimal perception is 
not innate but arbitrarily selected by E, and the stimulus object in 
question is absent at the time the response is made. 

These conditions obtained in the experiments to be reported in 

1 The author is indebted to Mr. S. E. Burgess, who carried out a pilot study 
with children and is responsible for the preparation of most of the stimulus 


material. 
E Now temporarily at the Center for Advanced Study in the Behavioral 


Sciences. 


f “drive” and “drive-reduction” 


sounce: D. E. Berlyne, “Conflict and Information-Theory Variables as Deter- 

minants of Bod Perceptual (on Journal of Experimental Psychology 
. Reprinte issi i al 

1957, 53, TE oe y permission of the American Psychological 


Association an 
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this article. Tachistoscopic exposures of visual figures resulted from 
pressing a finger key, and Ss were free to expose themselves to each 
figure as many times as they wished. After each exposure, Ss found 
themselves in darkness. Fluctuations in the probability of making 
another response can therefore be attributed to some internal stimu- 
lus condition or drive, If this probability turns out to depend on the 
nature of the figure just exposed and the number of times it has 
already been seen, these variables can be regarded as drive- 
conditions, influencing the strength of the drive. If the probability 
of a further response decreases as a particular figure is repeatedly 
exposed, the exposures can be said to bring about the satiation or 
reduction of the drive, 

By analogy with such drives as hunger or thirst, which are com- 
monly measured by amount of consummatory activity (cf. Berkun, 
Kessen, & Miller, 1952), the number of exposures of a particular 
figure before S gave up responding was taken as an indication of the 
intensity of the drive aroused by that figure. The ultimate cessation 


of responding can be attributed, as with eating and drinking, both 
to a reduction in the energizi 


motivation is renewed, 

A drive which is reduced 
ceptual curiosity and provisi 
curiosity, which is reduced by the ac 
lyne, 1954b ). One class of variable th 


situation ( Berlyne, 1955; Berlyne & S] 
1956b ). This is related to relative entro 
(Shannon & Weaver, 1949) which 
be an important attribute of 


Py, the inverse of redundancy 
ich Attneave (1954) has shown to 
„Visual figures. One of the principal 


e information theorist’s entropy 
or uncertainty (Shannon & Weaver, 1949), An important case of 


ict, aroused by a stimulus pattern 
with characteristics which S has been trained to regard as eee 
patible. Another is surprise-conflict 


: P ct, produced when a stimulus 
pattern fails to confirm an expectation evoked by what preceded it. 
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Secondly, the theory implied that epistemic curiosity will increase 
with the number of previous gratifications of the drive in similar 
situations. If all these factors can be shown to affect human per- 
ceptual curiosity, then the grounds for differentiating between per- 
ceptual and epistemic curiosity will become more tenuous. 


METHOD 


Apparatus 
A tachistoscope (a simplified version of the one described in Hum- 
phrey, Dawe, & Mandell, 1955), operating with two short-decay phosphor 
fluorescent tubes and taking 6-in. square cards, was connected with a 
finger key. Whenever the key, which resembled the bar of a Skinner box, 


was depressed, the card in the tachistoscope became visible for .14 sec. 


Subjects 


Sixteen undergraduates from the first- and second-year psychology 


classes served as Ss. 


Procedure 

The S sat in a darkened room, 4 ft. from the tachistoscope, with his 
right hand holding the key. The use of the key was explained and dem- 
onstrated with two sample cards reserved for this purpose. He was told 
that the experiments were intended solely to show how interesting certain 
pictures were. The E would insert a card in the tachistoscope, and S was 
to begin pressing the key when E said “Now.” The S was to continue to 
press the key for as long as he wanted to continue seeing the card. When 


he no longer wanted to see it, he was to say “Yes,” and E would insert 
a new card. It was emphasized that no questions about the cards would 


be asked at any time. 


Design 

Each S underwent four experiments, which followed one another 
without interruption, used the same procedure, and differed only in 
stimulus material. Different Ss had the four experiments in four different 
sequences so that the design took the form of four replications of a counter- 


balanced 4 4 latin square (Bugelski, 1949). 


Stimulus Material 

Experiment 1 (Incongruity-Conflict) 
tures of Animals and a series of seven pictures of Birds (Figure 1), Cards 
2 and 4 of the Animals series and 3 ‘and 5 of the Birds series bore in- 
congruous pictures. Half of the Ss received the Animals series first and 
the other half the Birds series first. 

Experiment 2 (Meaningful Sequence). There was a series of six cards 
which began with a circle and developed by progressive addition of 
details into a picture of a Bear and a similar series of six cards changing 


. There was a series of seven pic- 
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"Animals" series 
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(yo 9 IA 5 
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1 2 3 4 5 

"Birds" series 
1 2 3 4 3 6 7 
Ficure 1. The stimulus material, Experiment 1. 
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The four possible sequences—Bear meaningful Clown random, Clown 
meaningful Bear random, Bear random Clown meaningful, and Clown 
random Bear meaningful—were used with equal numbers of Ss. 


Experiment 2. 


ORRRR 


"Clown" series 


CR AR A 


Ficure 2. The stimulus material, Experiment 2. 


Experiment 3 (Surprise-Conflict) . There were 12 card. 
metrical patterns made up of colored Spots (Figure 3). The patterns of 
Cards 1-6 were composed of red triangles, those of Cards 7-1] of green 
circles, and that of Card 12 of violet Squares, 

Experiment 4 (Relative Entropy). There w 
each bearing patterns differing in redundancy, As Attneave ( 1954) shows, 
redundancy varies directly with orderly arrangement, with symmetry and 
vee nalnty beter pero o a Res wl ivaa wil eet 
contour. Series A contained a card bearing mine crosses in a regular matrix 

ttern and a card bearing nine crosses in an irregular arrangement (Fig- 
4). Series B consisted of four cards bearing a circle, a square. an 


s bearing geo- 


ere three series of cards 
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Experiment _3. 
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Ficure 3. The stimulus material, Experiment 3. 
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FIGURE 4. The stimulus material, Experiment 4. 


octagon, and an irregular closed curve, all of approximately equal perime- 
ter. These figures have, respectively, zero, four, eight, and an infinite 
set of points at which the curvature changes and hence represent pro- 
gressively smaller degrees of redundancy. The four cards of Series C 
present patterns of five straight lines, of two straight and three wavy 
lines arranged symmetrically, of two straight and three wavy lines ar- 
ranged asymmetrically and of five lines of different sorts. Redundancy 
therefore increases from the first card to the last. 

Two sequences, based on random numbers, were worked out for all 


10 cards, and each sequence was used with half the Ss. 


ResULTS AND DISCUSSION 


Determinants of Curiosity 
PREVIOUS GRATIFICATIONS OF THE DRIVE. The mean numbers of 
responses per card were worked out for Ss by experiments and are 


_—— 
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displayed in Table 1. They were then subjected to an analysis of 
variance, with the results shown in Table 2. It will be seen that 
the effect of the temporal position of an experiment is significant. 
When this effect is analyzed further, it is found that the linear and 
quadratic components of the trend are significant but that the devi- 
ation from the quadratic trend is not. This means that the data do 
not depart significantly from the best-fitting quadratic curve and 
that the trend represented by this curve is significant. The curve 
happens to be a negatively accelerated rising one, similar in shape 
to the usual learning curve. The results are therefore compatible 
with the assumptions of the theory (Berlyne, 1954a, 1954b ), accord- 


ing to which curiosity will increase with the number of previous 
opportunities to gratify it in similar circumstances, 


TABLE 1 
Mean Responses per Card by Experiments 


1 1.32 I 2.4 84 
2 2.4 91 Il 2.6 1.20 
3 2.1 80 III 3.0 1.20 
4 


TABLE 2 


Between-Experiments Analysis of Variance 


Source df M 


s F 


3 1.088 
Ss within sequences 12 2.806 
Total between Ss 15 2.462 10.42 
Experiments 3 9.106 38.58+ 
Temporal positions: 
a. linear component 1 1.435 6.08° 
b. quadratic component 1 1.331 5.64° 
ç. deviation from quadratic trend 1 0.740 3.14 
Temporal positions: total 3 1.169 4.95° 
Residual (error) 42 0.236 
Total 63 
© Significant at .05 level. 


ł Significant at .001 level. 
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Inconcrurry-Conruicr. In Experiment 1, the mean numbers of 
responses per card were 5.8 for the four incongruous pictures and 
3.0 for the 10 nonincongruous pictures. As the analysis of variance 
summarized in Table 3 shows, the difference is highly significant, 


and so the predicted importance of incongruity-conflict is vindicated. 


MEANINGFULNESS OF SEQUENCE. Although meaningfulness of se- 
quence was not one of the variables figuring in the theory, it was 
tested in Experiment 2 as a factor likely to be influential. The means 
were, however, 2.4 responses per card for both meaningful-sequence 


TABLE 3 
Analysis of Variance: Exp. 1 
df MS F 
Incongruous/Nonincongruous I/NI 1 382.00 (a) 32.73 
15 26.20 (b) 6.44t 


Ss 
Ss x I/NI (a) 15 11.67 (b) 287° 
Residual (b) 192 4.07 


bs Significant at .01 level. 
+ Significant at .001 level. 


Source 


and random-sequence series, and so no effect can be attributed to 


this factor. 

Surprise-ConFiicr. In Experiment 8, the two cards which intro- 
duced unexpected changes were Cards 7 and 12. These were com- 
pared with the remainder, with the exception of Card 1. Card 1 was 
disregarded because of its equivocal status at the beginning of the 
series. The two surprise cards produced a mean of 2.4 responses 
and the nine nonsurprise cards a mean of 2.0 responses. As the 
analysis of variance in Table 4 shows, the difference, which follows 


the predicted direction, is significant. l 
Rerarve Entropy. The three series of cards in Experiment 4 
each provided a separate test for the relative-entropy variable. In 
Series A, the mean numbers of responses were 2.6 for Card I and 
4.2 for Card 2. A t test leads to a p-value of less than .05 (t = 2.43, 
-, respectively, of Series B were 


df= 15). The means for cards 1 à 5 
12, 1.6, 1.8, and 3.2. For Cards 1-4, respectively, of Series C, they 


were 1.7, 2.6, 2.8, and 3.3. In both of these series, therefore, the 
means followed exactly the predicted order (out of 24 possible 
permutations in each case). Ranking analyses of variance demon- 
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strate that the differences, for both series, reach the .01 level of 
significance (x°, = 18.47 for Series B and 15.69 for Series C, 
df = 3). 

ABSOLUTE ENTRopy. The variable tested in Experiment 4 ee 
relative entropy or uncertainty. This is the ratio of the amount o 
information received from a figure to the maximum that could be 
received from a figure with the same quantity of material. In other 
words, it is a measure of the extent to which parts of the figure are 
unexpected in view of the nature of the other parts or, more briefly, 
a measure of the amount of variety in the figure, 


TABLE 4 
Analysis of Variance: Exp. 3 


Source df MS p 
Surprise/Nonsurprise (S/NS) 1 4.00 6.35° 
Ss 


Ss X S/NS 15 
Residual (error) 144 


Total 


175 
q Significant at .01 level by one-tailed test, 
1 


t Significant at .001 level 


TABLE 5 
Analysis of Variance; Exp. 2 


Source df MS F 
Amounts of detail (D) 2 19.50 (a) 990° 
Ss 15 1013 (b) 13,51 
Ss X D (a) 30 1.97 (b) 263° 
Residual (b) 144 .75 
Total 191 


° Significant at .001 level. 


Provided by Experiment 
2. It will be seen that the cards of both series numbered 1, 2-5 and 


6 form three sets differing markedly in “Mount OF onranafiioa 
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detail. The mean responses per card for these three sets are 1.6, 2.8, 
and 3.1, respectively, and, as Table 5 shows, the F value for this 
comparison is significant. The differences between figures varying 
in amount of detail can be described in terms of statistical informa- 
tion theory (Shannon & Weaver, 1949), if the parts of the figures 
are regarded as signals. But the concept of “structural information” 
(Mackay, 1950) is clearly also relevant. 


Alternative Theories 

The Pavlovian concept of an “investigatory reflex” (Pavlov, 1927; 
Sokolov, 1955) cannot account for our results, as the response was 
not a receptor adjustment but an arbitrary learned movement and, 
furthermore, the visual stimulus investigated was not present until 
the response had been performed. Estes (1956, p. 11), referring 
to experiments which purport to demonstrate learning under the 
influence of an exploratory drive, claims that Guthrie’s contiguity 
theory could equally well handle the facts. It is not easy to see how 
this theory could handle our data, without assuming some internal 
stimulus condition which would amount to much the same as a 


curiosity drive. 


Comparison with Children 

Burgess (1956) performed Experiment 1 and slightly modified 
versions of Experiment 2 and 3 with 18 5-yr.-old children and with a 
.014-sec. exposure. The principal differences from our results were: 
(a) the children responded many more times per card (mean = 12.1, 
SD = 7.75); and (b) no effect of incongruity or surprise was mani- 
fested. In order to ascertain whether the first difference was due to 
the age of the children or to the shorter exposure, four Ss from a 
fourth-year psychology class were put through gery 1 
with a latin-square design and a .014-sec. exposure. Their mean 


d for Experiment 1-3 came to 2.3, with 
number of responses per card tor xp oe. 97-28) Pee 


an SD of .70. A Cochran-Cox test (Lindquist, 19 í 

the diference between their mean and that of the children to be 
significant at the .01 level. One can ore conclude that the 
children’s greater resistance to satiation was not due to the shorter 
exposure alone. Without further experimentation, it is not possible 
to reach any conclusion with respect to the other difference. The 
fact that the children exhibited more curiosity than the adults is in 
harmony with Welker’s finding (1956b) that young chimpanzees 
indulge in more exploratory manipulation of objects than their 


elders. 
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